-- Logs begin at Thu 2022-08-04 20:03:28 UTC, end at Thu 2022-08-04 22:12:40 UTC. -- Aug 04 21:31:37.261855 dv-cinder-852209-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 21:31:37.272194 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 21:31:37.274890 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 21:31:37 2022] *** Aug 04 21:31:37.274890 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 21:31:37.274890 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 21:31:37.274890 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: nodename: dv-cinder-852209-1-iscsi Aug 04 21:31:37.274890 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: machine: x86_64 Aug 04 21:31:37.274890 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: clock source: unix Aug 04 21:31:37.274890 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: pcre jit disabled Aug 04 21:31:37.274890 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: detected number of CPU cores: 4 Aug 04 21:31:37.274890 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: current working directory: / Aug 04 21:31:37.274890 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: detected binary path: /usr/bin/uwsgi-core Aug 04 21:31:37.274890 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: your processes number limit is 47680 Aug 04 21:31:37.275690 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: your memory page size is 4096 bytes Aug 04 21:31:37.275690 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: detected max file descriptor number: 2048 Aug 04 21:31:37.275690 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: lock engine: pthread robust mutexes Aug 04 21:31:37.275690 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: thunder lock: enabled Aug 04 21:31:37.275690 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 21:31:37.275690 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 21:31:37.315673 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: Python main interpreter initialized at 0x560cce0259c0 Aug 04 21:31:37.315673 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: python threads support enabled Aug 04 21:31:37.315673 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: your server socket listen backlog is limited to 100 connections Aug 04 21:31:37.315673 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: your mercy for graceful operations on workers is 90 seconds Aug 04 21:31:37.316232 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 21:31:37.316232 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: *** Operational MODE: preforking *** Aug 04 21:31:37.316469 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: *** uWSGI is running in multiple interpreter mode *** Aug 04 21:31:37.316469 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: spawned uWSGI master process (pid: 121819) Aug 04 21:31:37.316679 dv-cinder-852209-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 21:31:37.317812 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: spawned uWSGI worker 1 (pid: 121820, cores: 1) Aug 04 21:31:37.317812 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: spawned uWSGI worker 2 (pid: 121821, cores: 1) Aug 04 21:31:37.317812 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 21:31:37.999370 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 21:31:38.042335 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 21:31:39.096568 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 21:31:39.096568 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: from cryptography.utils import int_from_bytes Aug 04 21:31:39.097211 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 21:31:39.097211 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: from cryptography.utils import int_from_bytes Aug 04 21:31:39.172337 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 21:31:39.172337 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: from cryptography.utils import int_from_bytes Aug 04 21:31:39.172956 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 21:31:39.172956 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: from cryptography.utils import int_from_bytes Aug 04 21:31:41.797334 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 21:31:41.797970 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 21:31:41.798166 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 21:31:41.798483 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 21:31:41.798574 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 21:31:41.798946 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 21:31:41.799024 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 21:31:41.799106 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.799298 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 21:31:41.799428 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.799660 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 21:31:41.799752 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.799916 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 21:31:41.800048 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.800305 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.800390 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.800630 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.800714 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.800951 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.801043 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.801269 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.801363 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.801588 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.801685 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.801846 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.801930 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.802180 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.802289 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.802703 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-1-iscsi {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.802853 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.803120 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.803405 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.803490 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.803782 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.803866 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.804102 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.804420 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.804512 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.804869 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.805172 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-1-iscsi {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.805314 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.805571 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.805673 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.806081 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.806219 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.806340 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.806473 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.806641 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.806760 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.806956 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.807078 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.807284 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.807458 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.807593 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.807695 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.807910 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.808104 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.808214 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.808416 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.808524 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.808729 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.808812 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.809041 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.809216 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-1-iscsi {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.809379 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.809531 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.809695 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.809986 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.810147 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.810326 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.810411 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.810650 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.810748 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.810975 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.811110 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.811285 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.811424 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.811625 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.811716 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-1-iscsi {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.811943 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.812036 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.812248 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.812346 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.812571 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.812701 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.812885 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.812988 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.813198 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.813283 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.813512 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.813608 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.813815 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.813962 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.814143 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.814244 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.814449 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.814541 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.814764 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.814859 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.815063 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.815154 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.815363 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.815459 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.815609 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.815776 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.815911 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.816078 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.816227 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.816385 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.816543 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.816693 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.816865 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.817015 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.817119 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.817322 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.817419 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.817624 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.817712 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.818401 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.818544 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.818714 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.818816 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.819036 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.819178 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.819368 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.819463 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.819662 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.819759 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.819918 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.820003 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.820169 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.820267 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.820486 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.820573 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.820807 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.820892 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.821113 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.821206 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.821420 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.821514 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.821725 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.821809 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.822063 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.822169 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.822354 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.822447 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.822659 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.822766 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.822962 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.823053 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.823267 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.823352 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.823585 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.823684 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.823898 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.823983 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.824196 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.824281 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.824508 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.824592 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.824823 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.824917 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.825124 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.825253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.825427 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.825521 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.825729 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.825814 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.826068 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.826158 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.826389 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.826486 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.826692 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.826775 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.826937 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.827021 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.827241 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.827351 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.827538 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.827623 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.827851 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.827935 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.828418 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.828528 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.828617 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.828696 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.828773 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.828849 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.829022 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.829109 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.829321 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.829408 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.829620 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.829704 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.829918 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.830032 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.830243 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.830330 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.830549 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.830674 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.830850 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.830951 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.831149 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.831244 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.831447 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.831537 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.831746 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.831837 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.832046 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.832136 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.832349 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.832440 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.832647 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.832745 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.832948 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.833054 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.833247 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.833417 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.833595 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.834460 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.834460 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.834667 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.834761 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.834841 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.835024 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.835111 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.835342 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.835427 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.835653 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.835765 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.835960 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.836052 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.836265 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.836366 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.836571 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.836682 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.836878 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.837002 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.837177 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.837380 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.837478 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.837579 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.837764 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.837861 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.838100 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.838206 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.838409 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.838532 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.838853 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.838970 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.839158 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.839303 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.839303 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.839509 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.839592 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.839671 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.839865 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.839961 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.840162 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.840259 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.840460 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.840555 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.840755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.840850 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.841059 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.841140 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.841364 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.841440 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.841662 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.841737 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.841962 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.842068 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.842289 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.842365 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.842589 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.842664 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.842892 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.842969 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.843189 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.843276 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.843510 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.843586 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.843829 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.843913 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.844136 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.844212 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.844440 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.844528 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.844746 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.844822 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.845062 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:31:41.845137 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.845369 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.845453 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.845692 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.845768 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.846000 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.846097 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.846350 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.846440 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.846664 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.846740 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.846978 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.847062 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.847298 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.847376 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.847608 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.847690 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.847924 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.848059 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.848231 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.848358 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.848547 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.848657 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.848852 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.848948 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.849204 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.849363 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.849625 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.849799 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.849977 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.850208 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.850377 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.850482 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.850862 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.851070 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.851206 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.851522 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.851634 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.851843 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.852167 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.852263 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.852478 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.852566 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.852786 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.852877 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.853095 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.853182 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.853418 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.853750 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.853847 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.854088 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.854343 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.854474 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.854829 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.854936 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.855142 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.855453 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.855540 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.855782 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.855886 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.856140 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.856236 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.856397 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.856639 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.856818 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.857008 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.857200 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.857326 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.857641 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.857991 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.858344 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.858344 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.858522 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.858606 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.858852 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.858948 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.859153 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.859433 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.859521 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.859750 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.860202 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.860306 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.860398 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.860489 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.860664 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.860758 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.860967 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.861061 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.861296 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.861394 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.862132 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.862250 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.862335 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.862415 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.862546 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.862651 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.862779 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.862868 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.863081 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.863176 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.863389 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.863478 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.863698 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.863794 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.864002 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.864090 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.864332 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.864488 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.864635 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.864727 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.865050 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.865201 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.865368 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.865516 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.865677 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.865829 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.865959 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.866155 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.866455 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.866546 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.866777 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.866941 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.867107 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.867270 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.867415 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.867585 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.867750 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.867902 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.868058 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.868228 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.868381 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.868548 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.868694 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.869039 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.869151 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.869244 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.869327 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.869514 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.869612 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.869815 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.869904 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.870162 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.870255 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.870694 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.870809 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.870903 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.871003 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.871086 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.871406 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.871512 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.871596 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.871676 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.871763 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.871968 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.872056 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.872271 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.872386 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.872582 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.872680 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.872883 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.872972 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.873184 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.873273 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.873485 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.873582 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.873787 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.873875 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.874110 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.874211 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.874432 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.874529 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.874742 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.874833 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.875049 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.875180 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.875466 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.875602 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.875767 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.876072 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.876257 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.876344 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.876429 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.876595 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.876724 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.877014 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.877122 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.877296 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.877377 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.877446 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.877706 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.877783 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.877949 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.878078 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.878346 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.878463 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.878592 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.878669 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.878849 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.878970 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.879131 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.879264 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.879435 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.879619 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.879738 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.879956 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.880062 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.880286 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.881929 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.882181 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.882181 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.882436 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.882579 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.882711 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.882845 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.882970 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.883093 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.883230 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.883375 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.883512 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.883655 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.883796 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.883954 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.884093 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.884233 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.884376 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.884519 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.884662 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.884862 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.884952 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.885032 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.885133 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.885292 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.885438 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.885596 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.885742 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.885857 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.885939 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.886034 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.886129 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.886286 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.886364 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.886597 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.886685 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.886915 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.887083 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.887222 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.887309 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.887547 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.887635 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.887856 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.887953 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.888173 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.888259 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.888480 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.888567 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.888794 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.888904 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.889118 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.889227 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.889447 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.889542 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.889759 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.889879 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.890095 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.890186 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.890403 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.890492 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.890718 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.890808 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.891027 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.891376 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.891565 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.891667 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.891984 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.892153 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.892279 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.892379 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.892674 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.892834 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.892930 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.893000 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.893067 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.893132 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.893197 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.893262 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.893380 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.893474 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.893680 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.893761 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.893991 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.894085 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.894338 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.894424 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.894643 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.894718 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.894944 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.895028 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.895249 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.895345 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.895567 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.895656 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.895872 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.895968 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.896781 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.896884 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.897202 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.897298 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.897509 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.897608 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.897816 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.897907 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.898181 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.898318 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.898488 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.898586 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.898789 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.898874 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.899091 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.899222 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.899509 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.899661 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.899864 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.899999 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.900303 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.900410 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.900504 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.900607 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.900698 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.900848 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.900949 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.901039 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.901222 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.901343 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.901429 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.901724 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.901895 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.901983 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.902104 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.902317 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.902423 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.902706 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.902881 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.903008 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.903230 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.903349 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.903435 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.903850 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.904054 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.904177 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.904262 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.904342 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.904420 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.904498 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.904577 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.904668 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.904748 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.904827 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.905033 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.905181 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.905343 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.905441 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.905646 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.905755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.905962 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.906110 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.906422 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.906512 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.906684 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.907001 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.907077 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.907309 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.907394 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.907618 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.907693 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.907933 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.908008 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.908243 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.908327 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.908550 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.908626 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.908868 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.908955 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.909332 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.909450 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.909647 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.909734 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.909950 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.910106 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.910297 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.910382 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.910604 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.910782 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.910898 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.911058 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.911203 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.911414 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.911523 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.911827 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.911980 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.912123 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.912296 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.912479 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.912735 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.912865 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.913064 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.913251 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.913363 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.913614 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.913732 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.913992 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.914150 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.914332 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.914467 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.914683 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.914795 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.914972 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.915091 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.915307 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.915438 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.915612 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.915747 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.915921 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.916045 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.916223 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.916347 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.916528 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.916661 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.916829 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.916955 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.917128 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.917239 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.917430 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.917541 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.917731 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.917845 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.918105 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.918226 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.918436 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.918548 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.918773 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.918887 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.919074 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.919186 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.919376 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.919488 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.919691 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.919806 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.919993 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.920116 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.920291 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.920405 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.920589 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.920709 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.920884 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.921012 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.921186 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.921303 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.921483 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.921596 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.921780 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.921904 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.922102 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.922217 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.922410 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.922519 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.922714 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.922841 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.923013 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.923124 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.923317 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.923440 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.923635 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.923826 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.923970 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.924126 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.924282 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.924392 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.924562 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.924683 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.924859 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.924971 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.925158 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.925268 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.925458 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.925606 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.925753 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.925872 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.926082 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.926201 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.926384 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.926500 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.926691 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.926801 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.926995 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.927105 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.927316 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.927440 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.927619 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.927767 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.927905 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.928186 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.928349 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.928489 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.928617 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.928790 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.928904 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.929094 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.929216 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.929394 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.929506 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.929691 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.929830 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.929994 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.930119 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.930321 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.930446 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.930620 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.930726 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.930920 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.931027 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.931228 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.931327 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.931534 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.931713 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.931836 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.931944 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.932119 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.932231 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.932418 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.932547 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.932717 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.932828 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.933012 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.933122 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.933314 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.933436 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.933612 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.933723 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.933904 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.934048 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.934249 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.934382 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.934563 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.934675 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.934865 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.934984 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.935181 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.935282 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.935485 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.935572 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.935784 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.935877 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.936083 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.936170 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.936440 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.936538 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.936723 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.936811 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.937021 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.937121 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.937333 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.937463 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.937629 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.937718 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.937930 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.938058 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.938254 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.938341 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.938562 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.938717 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.938861 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.938951 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.939149 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.939236 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.939443 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.939539 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.939739 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.939825 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.940040 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.940154 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.940343 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.940522 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.940641 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.940728 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.940946 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.941096 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.941254 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.941361 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.941540 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.941626 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.941843 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.941936 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.942184 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.942274 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.942502 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.942587 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.942822 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.943450 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.943701 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.943831 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.944007 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.944161 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.944316 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.944566 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.944678 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.944880 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.945026 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.945193 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.945311 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.945490 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.945649 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.945802 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.945935 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.946133 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.946257 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.946443 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.946585 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.946728 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.946819 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.947027 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.947127 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.947340 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.947469 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.947639 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.947765 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.947935 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.948053 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.948250 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.948345 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.948554 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.948645 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.948860 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.948966 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.949162 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.949262 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.949462 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.949567 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.949760 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.949882 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.950075 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.950239 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.950374 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.950504 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.950682 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.950810 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.950998 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.951102 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.951302 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.951393 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.951611 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.951718 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.951915 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.952010 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.952220 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.952309 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.952523 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.952619 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.952826 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.952925 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.953130 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.953219 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.953432 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.953529 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.953751 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.953838 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.954080 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.954169 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.954386 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.954526 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.954692 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.954781 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.954991 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.955077 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.955297 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.955384 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.955590 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.955675 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.956008 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.956094 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.956355 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.956463 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.956620 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.956919 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.957013 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.957224 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.957418 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.957513 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.957771 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.957865 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.958217 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.958322 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.958520 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.959243 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.959621 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.959715 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.960310 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.960424 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.960518 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.960599 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.960678 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.961026 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.961119 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.961205 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.961294 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.961382 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.961747 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.961833 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.961920 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.962022 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.962416 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.962518 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.962601 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.962688 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.962856 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.962966 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.963119 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.963206 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.963420 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.963563 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.963718 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.963846 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.964016 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.964137 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.964335 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.964457 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.964658 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.964848 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.964949 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.965136 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.965284 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.965442 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.965745 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.965845 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.965977 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.966106 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.966313 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.966448 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.966630 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.966725 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.966963 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.967097 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.967258 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.967349 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.967557 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.967652 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.967865 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.967952 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.968165 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.968253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.968469 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.968620 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.968781 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.968916 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.969079 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.969173 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.969386 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.969532 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.969692 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.969804 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.969995 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.970114 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.970320 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.970417 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.970619 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.970729 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.970936 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.971030 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.971237 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.971333 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.971552 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.971646 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.971864 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.971958 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.972182 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.972271 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.972502 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.972588 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.972802 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.972903 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.973107 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.973204 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.973405 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.973501 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.973703 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.973790 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.974075 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.974187 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.974374 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.974615 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.974777 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.974927 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.975010 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.975225 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.975313 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.975529 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.975616 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.975830 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.975925 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.976147 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.976233 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.976448 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.976535 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.976766 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.976853 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.977078 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.977164 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.977397 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.977491 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.977720 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.977810 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.978041 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.978132 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.978349 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.978447 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.978657 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.978757 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.978957 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.979042 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.979255 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.979348 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.979556 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.979641 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.979859 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.979944 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.980159 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.980253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.980458 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.980544 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.980755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.980840 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.981070 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.981158 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.981369 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.981462 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.981688 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.981775 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.981994 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.982094 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.982315 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.982413 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.982617 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.982706 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.982916 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.983010 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.983251 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.983371 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.983550 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.983695 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.983851 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.983939 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.984157 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.984295 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.984455 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.984594 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.984753 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.984883 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.985056 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.985147 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.985355 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.985456 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.985651 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.985747 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.985951 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.986084 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.986293 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.986393 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.986593 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.986680 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.987162 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.987258 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.987469 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.987566 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.987768 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.987856 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.988069 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.988156 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.988366 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.988637 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.988726 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.988964 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.989059 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.989278 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.989373 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.989588 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.989674 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.989979 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.990164 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.990314 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.990441 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.990627 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.990725 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.990936 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.991032 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.991244 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.991340 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.991550 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.991641 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.991857 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.991945 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.992179 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.992266 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.992485 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.992574 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.992794 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.992880 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.993102 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.993190 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.993416 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.993515 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.993724 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.993969 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.994095 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.994324 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.994413 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.994639 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.994727 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.994953 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.995041 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.995267 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.995354 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.995573 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.995668 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.995882 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.995969 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.996189 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.996273 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.996495 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.996582 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.996800 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.996888 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.997104 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.997198 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.997413 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.997511 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.997720 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.997808 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.998042 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.998171 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.998355 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.998501 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.998663 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.998751 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.998983 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.999077 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.999292 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.999387 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.999610 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.999698 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:41.999916 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.000002 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.000224 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.000319 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.000535 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.000624 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.000843 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.001049 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.001143 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.001361 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.001447 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.001691 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.001777 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.002053 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.002145 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.002356 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.002444 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.002663 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.002749 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.002971 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.003066 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.003274 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.003361 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.003582 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.003667 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.003882 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.003970 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.004187 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.004273 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.004493 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.004581 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.004794 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.004891 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.005115 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.005224 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.005962 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.006115 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.006290 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.006386 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.006607 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.006890 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.007025 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.007204 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.007536 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.007622 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.007857 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.007945 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.008177 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.008272 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.008492 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.008579 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.008803 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.008889 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.009113 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.009206 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.009415 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.009502 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.009720 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.009807 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.010030 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.010132 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.010345 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.010433 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.010644 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.010729 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.010949 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.011036 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.011248 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.011335 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.011546 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.011640 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.011850 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.011937 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.012155 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.012241 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.012452 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.012681 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.012770 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.013023 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.013109 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.013333 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.013419 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.013629 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.013724 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.013928 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.014070 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.014251 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.014338 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.014557 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.014645 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.014855 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.014948 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.015153 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.015239 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.015451 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.015537 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.015746 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.015831 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.016049 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.016143 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.016346 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.016434 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.016643 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.016730 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.016938 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.017032 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.017242 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.017327 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.017535 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.017620 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.017838 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.017936 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.018159 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.018246 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.018478 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.018563 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.018776 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.018873 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.019072 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.019158 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.019376 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.019462 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.019679 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.019766 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.019978 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.020065 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.020278 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.020365 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.020576 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.020663 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.020872 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.020958 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.021271 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.021877 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.022285 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.022383 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.022594 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.022724 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.022895 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.022984 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.023203 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.023292 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.023511 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.023643 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.023805 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.023902 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.024105 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.024192 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.024422 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.024522 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.024723 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.024824 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.025052 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.025137 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.025358 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.025444 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.025662 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.025887 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.026053 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.026150 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.026290 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.026378 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.026593 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.026693 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.026896 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.026983 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.027206 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.027292 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.027512 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.027756 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.027844 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.028085 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.028181 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.028396 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.028490 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.028701 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.028788 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.029005 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.029095 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.029314 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.029409 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.029613 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.029699 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.029915 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.030023 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.030260 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.030350 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.030568 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.030672 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.030873 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.030960 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.031176 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.031263 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.031479 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.031565 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.031783 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.031878 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.032085 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.032179 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.032391 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.032477 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.032695 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.032829 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.033000 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.033096 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.033304 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.033456 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.033595 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.033718 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.033895 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.034061 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.034229 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.034366 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.034534 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.034682 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.034845 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.034989 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.035180 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.035308 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.035494 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.035627 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.035811 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.035949 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.036125 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.036238 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.036436 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.036544 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.036812 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.037001 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.037234 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.037362 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.037528 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.037696 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.037839 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.038042 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.038186 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.038355 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.038514 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.038658 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.038825 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.038960 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.039128 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.039263 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.039549 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.039648 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.039855 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.039943 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.040155 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.040259 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.040456 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.040552 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.040765 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.040853 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.041064 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.041203 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.041365 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.041453 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.041663 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.041750 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.041961 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.042069 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.042301 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.042389 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.042599 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.042685 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.042897 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.042985 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.043196 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.043290 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.043494 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.043582 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.043793 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.043925 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.044091 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.044193 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.044394 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.044481 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.044691 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.044780 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.044991 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.045079 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.045290 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.045385 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.045590 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.045681 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.045888 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.045975 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.046218 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.046320 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.046520 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.046608 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.046823 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.046910 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.047124 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.047219 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.047470 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.047565 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.047731 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.047820 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.048030 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.048126 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.048326 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.048413 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.048621 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.048717 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.048920 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.049012 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.049225 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.049312 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.049525 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.049612 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.049832 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.049921 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.050154 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.050245 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.050457 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.050556 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.050759 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.050854 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.051062 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.051156 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.051358 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.051457 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.051680 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.051773 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.052002 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.052091 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.052809 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.052941 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.053176 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.053266 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.053545 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.053631 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.053864 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.054162 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.054269 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.054495 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.054583 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.054808 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.054896 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.055118 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.055331 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.055470 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.055658 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.055746 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.055973 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.056062 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.056329 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.056416 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.056637 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.056763 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.056944 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.057081 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.057250 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.057397 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.057556 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.057918 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.058056 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.058141 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.058224 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.058347 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.058505 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.058662 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.058826 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.058988 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.059139 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.059311 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.059459 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.059618 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.059773 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.059942 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.060080 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.060264 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.060405 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.060606 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.060695 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.060914 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.061001 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.061255 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.061355 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.061578 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.061689 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.061889 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.062062 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.062222 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.062380 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.062511 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.062643 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.062768 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 21:31:42.062857 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.063116 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.063428 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.063749 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.064071 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.064382 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.064696 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.065017 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.065358 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.065665 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.066052 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.066347 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.066656 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.066963 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.067264 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:31:42.067503 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 21:31:42.218871 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO dbcounter [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] Registered counter for database nova_api Aug 04 21:31:42.223164 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO dbcounter [None req-76ddac09-6392-407a-9074-3c7298bde663 None None] Registered counter for database nova_api Aug 04 21:31:42.240813 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_db.sqlalchemy.engines [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:31:42.245173 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG oslo_db.sqlalchemy.engines [None req-76ddac09-6392-407a-9074-3c7298bde663 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:31:42.247636 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG dbcounter [-] [121821] Writer thread running {{(pid=121821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:31:42.251882 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG dbcounter [-] [121820] Writer thread running {{(pid=121820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:31:42.303417 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.context [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4dbdb380-f63b-47cb-aa2b-0e711dd9c947(cell1) {{(pid=121821) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 21:31:42.307235 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:42.307707 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:42.309272 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:42.309390 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.context [None req-76ddac09-6392-407a-9074-3c7298bde663 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4dbdb380-f63b-47cb-aa2b-0e711dd9c947(cell1) {{(pid=121820) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 21:31:42.310144 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:42.310587 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:42.312585 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:42.313164 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG oslo_concurrency.lockutils [None req-76ddac09-6392-407a-9074-3c7298bde663 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:42.313644 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG oslo_concurrency.lockutils [None req-76ddac09-6392-407a-9074-3c7298bde663 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:42.314615 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO dbcounter [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] Registered counter for database nova_cell0 Aug 04 21:31:42.315247 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG oslo_concurrency.lockutils [None req-76ddac09-6392-407a-9074-3c7298bde663 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:42.315982 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG oslo_concurrency.lockutils [None req-76ddac09-6392-407a-9074-3c7298bde663 None None] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:42.316424 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG oslo_concurrency.lockutils [None req-76ddac09-6392-407a-9074-3c7298bde663 None None] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:42.319075 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG oslo_concurrency.lockutils [None req-76ddac09-6392-407a-9074-3c7298bde663 None None] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:42.321078 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO dbcounter [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] Registered counter for database nova_cell1 Aug 04 21:31:42.321197 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO dbcounter [None req-76ddac09-6392-407a-9074-3c7298bde663 None None] Registered counter for database nova_cell0 Aug 04 21:31:42.327127 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO dbcounter [None req-76ddac09-6392-407a-9074-3c7298bde663 None None] Registered counter for database nova_cell1 Aug 04 21:31:42.329034 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_db.sqlalchemy.engines [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:31:42.330942 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_db.sqlalchemy.engines [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:31:42.336947 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG dbcounter [-] [121821] Writer thread running {{(pid=121821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:31:42.337365 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG oslo_db.sqlalchemy.engines [None req-76ddac09-6392-407a-9074-3c7298bde663 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:31:42.338592 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG oslo_db.sqlalchemy.engines [None req-76ddac09-6392-407a-9074-3c7298bde663 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:31:42.345382 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG dbcounter [-] [121820] Writer thread running {{(pid=121820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:31:42.346872 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG dbcounter [-] [121820] Writer thread running {{(pid=121820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:31:42.478094 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG dbcounter [-] [121821] Writer thread running {{(pid=121821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:31:42.487211 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO dbcounter [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] Registered counter for database nova_cell0 Aug 04 21:31:42.497317 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_db.sqlalchemy.engines [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:31:42.501900 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG dbcounter [-] [121821] Writer thread running {{(pid=121821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:31:42.505924 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO dbcounter [None req-76ddac09-6392-407a-9074-3c7298bde663 None None] Registered counter for database nova_cell0 Aug 04 21:31:42.516059 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG oslo_db.sqlalchemy.engines [None req-76ddac09-6392-407a-9074-3c7298bde663 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:31:42.521230 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG dbcounter [-] [121820] Writer thread running {{(pid=121820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:31:42.928530 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: WARNING keystonemiddleware.auth_token [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 21:31:42.935764 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: WARNING keystonemiddleware.auth_token [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 21:31:42.975704 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: WARNING keystonemiddleware.auth_token [None req-76ddac09-6392-407a-9074-3c7298bde663 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 21:31:42.983224 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: WARNING keystonemiddleware.auth_token [None req-76ddac09-6392-407a-9074-3c7298bde663 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 21:31:43.275437 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: WARNING keystonemiddleware.auth_token [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 21:31:43.281707 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: WARNING keystonemiddleware.auth_token [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 21:31:43.287726 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560cce0259c0 pid: 121821 (default app) Aug 04 21:31:43.289975 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:43.291202 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] 10.222.0.73 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001922 Aug 04 21:31:43.291606 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 788 bytes} [Thu Aug 4 21:31:43 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:31:43.348533 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: WARNING keystonemiddleware.auth_token [None req-76ddac09-6392-407a-9074-3c7298bde663 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 21:31:43.355244 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: WARNING keystonemiddleware.auth_token [None req-76ddac09-6392-407a-9074-3c7298bde663 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 21:31:43.360812 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560cce0259c0 pid: 121820 (default app) Aug 04 21:33:07.629019 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:07.630053 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Aug 04 21:33:07.630465 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 2/2] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 4 21:33:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:33:07.642655 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG dbcounter [-] [121820] Writing DB stats nova_api:SELECT=3 {{(pid=121820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:07.644725 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG dbcounter [-] [121820] Writing DB stats nova_cell1:SELECT=3 {{(pid=121820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:07.646302 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG dbcounter [-] [121820] Writing DB stats nova_cell0:SELECT=3 {{(pid=121820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:07.647202 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG dbcounter [-] [121820] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=121820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:08.551486 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-20f729b2-a56a-4518-adb5-ae1410161f19 admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:08.582766 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-20f729b2-a56a-4518-adb5-ae1410161f19 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.945518 Aug 04 21:33:08.583513 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 1/3] 10.222.0.73 () {60 vars in 1292 bytes} [Thu Aug 4 21:33:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:10.816612 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:10.817606 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-69e262bb-10cf-4a17-9d0b-4b81b00d6bf3 None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Aug 04 21:33:10.818246 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 3/4] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 4 21:33:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:33:11.295266 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-63388e63-9f5a-419c-b551-caff2c661da9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "cirros256", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1}} {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:11.315629 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:33:11.315629 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: warnings.warn(msg) Aug 04 21:33:11.404997 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-63388e63-9f5a-419c-b551-caff2c661da9 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.579573 Aug 04 21:33:11.413643 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 2/5] 10.222.0.73 () {64 vars in 1283 bytes} [Thu Aug 4 21:33:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:33:11.632733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-6d08e8bc-914f-44bd-b754-60bc2d58dfe1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:11.637047 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:33:11.637047 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: warnings.warn(msg) Aug 04 21:33:11.639701 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG dbcounter [-] [121821] Writing DB stats nova_api:SELECT=3 {{(pid=121821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:11.640618 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG dbcounter [-] [121821] Writing DB stats nova_cell0:SELECT=3 {{(pid=121821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:11.641517 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG dbcounter [-] [121821] Writing DB stats nova_cell1:SELECT=3 {{(pid=121821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:11.642267 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG dbcounter [-] [121821] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=121821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:11.802837 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-6d08e8bc-914f-44bd-b754-60bc2d58dfe1 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.387863 Aug 04 21:33:11.810466 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 4/6] 10.222.0.73 () {64 vars in 1336 bytes} [Thu Aug 4 21:33:11 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:14.012627 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-63388e63-9f5a-419c-b551-caff2c661da9 admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:14.013640 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-63388e63-9f5a-419c-b551-caff2c661da9 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 04 21:33:14.014235 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 3/7] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 4 21:33:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:33:14.691585 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-d70bf626-fb2e-4183-8cc7-4b56404d2098 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5, "ram": 512, "id": "d1", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:14.711554 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:33:14.711554 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: warnings.warn(msg) Aug 04 21:33:14.822756 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-d70bf626-fb2e-4183-8cc7-4b56404d2098 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.802116 Aug 04 21:33:14.823343 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 5/8] 10.222.0.73 () {64 vars in 1283 bytes} [Thu Aug 4 21:33:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 21:33:14.838493 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-792463f9-1f50-4795-b31c-df014fadac25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:14.841564 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:33:14.841564 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: warnings.warn(msg) Aug 04 21:33:14.926612 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-792463f9-1f50-4795-b31c-df014fadac25 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091960 Aug 04 21:33:14.927441 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 4/9] 10.222.0.73 () {64 vars in 1336 bytes} [Thu Aug 4 21:33:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:17.138658 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-d70bf626-fb2e-4183-8cc7-4b56404d2098 admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:17.139696 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-d70bf626-fb2e-4183-8cc7-4b56404d2098 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 04 21:33:17.140128 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 6/10] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 4 21:33:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:33:17.535511 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-5f02d0f4-3e37-49dd-84c8-dfed7f0ae331 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "vcpus": 1, "ram": 1024, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:17.617896 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-5f02d0f4-3e37-49dd-84c8-dfed7f0ae331 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.471770 Aug 04 21:33:17.618497 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 5/11] 10.222.0.73 () {64 vars in 1283 bytes} [Thu Aug 4 21:33:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 21:33:17.631414 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-413497e1-de31-4376-b2c0-33425d62d991 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:17.717824 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-413497e1-de31-4376-b2c0-33425d62d991 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090841 Aug 04 21:33:17.718662 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 7/12] 10.222.0.73 () {64 vars in 1336 bytes} [Thu Aug 4 21:33:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:19.948591 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-5f02d0f4-3e37-49dd-84c8-dfed7f0ae331 admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:19.949605 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-5f02d0f4-3e37-49dd-84c8-dfed7f0ae331 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 04 21:33:19.950356 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 6/13] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 4 21:33:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:33:20.364936 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-7d6d8088-0eca-4dfa-840b-0b0a424e3ca5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d3", "os-flavor-access:is_public": true, "vcpus": 2, "disk": 10, "swap": 0, "name": "ds2G", "ram": 2048}} {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:20.496135 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-7d6d8088-0eca-4dfa-840b-0b0a424e3ca5 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.537470 Aug 04 21:33:20.496888 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 8/14] 10.222.0.73 () {64 vars in 1283 bytes} [Thu Aug 4 21:33:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:33:20.512356 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-bd3830d9-a5da-4c84-81b2-0575218d28a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:20.634900 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-bd3830d9-a5da-4c84-81b2-0575218d28a1 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126113 Aug 04 21:33:20.635395 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 7/15] 10.222.0.73 () {64 vars in 1336 bytes} [Thu Aug 4 21:33:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:22.880244 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-7d6d8088-0eca-4dfa-840b-0b0a424e3ca5 admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:22.881243 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-7d6d8088-0eca-4dfa-840b-0b0a424e3ca5 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 04 21:33:22.881646 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 9/16] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 4 21:33:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:33:23.295553 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-03e32661-7ed2-4220-bb15-41ba169342a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "name": "ds4G", "disk": 20, "id": "d4"}} {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:23.382504 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-03e32661-7ed2-4220-bb15-41ba169342a1 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.494918 Aug 04 21:33:23.383063 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 8/17] 10.222.0.73 () {64 vars in 1283 bytes} [Thu Aug 4 21:33:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 21:33:23.397914 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-bdc5e207-230b-49a2-87c3-6843d20808ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:23.547210 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-bdc5e207-230b-49a2-87c3-6843d20808ae admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.155018 Aug 04 21:33:23.547722 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 10/18] 10.222.0.73 () {64 vars in 1336 bytes} [Thu Aug 4 21:33:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:25.819405 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-03e32661-7ed2-4220-bb15-41ba169342a1 admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:25.820411 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-03e32661-7ed2-4220-bb15-41ba169342a1 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 04 21:33:25.820810 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 9/19] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 4 21:33:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:33:26.278211 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-fe82c23b-60a5-4fff-a4d2-7cfb82215863 admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:26.303139 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-fe82c23b-60a5-4fff-a4d2-7cfb82215863 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.476225 Aug 04 21:33:26.303759 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 11/20] 10.222.0.73 () {60 vars in 1292 bytes} [Thu Aug 4 21:33:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:33:28.545221 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-03e32661-7ed2-4220-bb15-41ba169342a1 admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:28.546268 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-03e32661-7ed2-4220-bb15-41ba169342a1 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 04 21:33:28.546690 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 10/21] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 4 21:33:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:33:28.980103 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-90dbf631-a52b-410b-8016-537fd653bedb admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "ram": 512, "vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:29.056533 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-90dbf631-a52b-410b-8016-537fd653bedb admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.501694 Aug 04 21:33:29.057272 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 12/22] 10.222.0.73 () {64 vars in 1283 bytes} [Thu Aug 4 21:33:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:33:29.070529 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-eb9f332a-32c6-42de-b15c-a2f0d6993842 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:29.156974 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-eb9f332a-32c6-42de-b15c-a2f0d6993842 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090201 Aug 04 21:33:29.158131 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 11/23] 10.222.0.73 () {64 vars in 1333 bytes} [Thu Aug 4 21:33:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:31.375165 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-90dbf631-a52b-410b-8016-537fd653bedb admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:31.376172 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-90dbf631-a52b-410b-8016-537fd653bedb admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 04 21:33:31.376575 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 13/24] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 4 21:33:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:33:31.776968 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-49467738-f4a6-48f0-9e37-95dbd2a24ebf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "disk": 20, "name": "m1.small", "id": "2"}} {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:31.843401 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-49467738-f4a6-48f0-9e37-95dbd2a24ebf admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.460691 Aug 04 21:33:31.843963 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 12/25] 10.222.0.73 () {64 vars in 1283 bytes} [Thu Aug 4 21:33:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 21:33:31.856651 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-f9a5e7dd-8d1e-4ad9-bf91-5f6ffbfbce87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:31.935907 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-f9a5e7dd-8d1e-4ad9-bf91-5f6ffbfbce87 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082898 Aug 04 21:33:31.936488 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 14/26] 10.222.0.73 () {64 vars in 1333 bytes} [Thu Aug 4 21:33:31 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:34.152396 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-49467738-f4a6-48f0-9e37-95dbd2a24ebf admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:34.153481 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-49467738-f4a6-48f0-9e37-95dbd2a24ebf admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 04 21:33:34.153905 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 13/27] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 4 21:33:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:33:34.571210 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-5303c3ec-814c-4cf7-a1e0-11e826770032 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "id": "3", "disk": 40, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium"}} {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:34.653197 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-5303c3ec-814c-4cf7-a1e0-11e826770032 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.492206 Aug 04 21:33:34.653748 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 15/28] 10.222.0.73 () {64 vars in 1283 bytes} [Thu Aug 4 21:33:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:33:34.666956 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-3a26ad16-5b29-42f7-abe5-43103b080775 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:34.746401 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-3a26ad16-5b29-42f7-abe5-43103b080775 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083357 Aug 04 21:33:34.746906 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 14/29] 10.222.0.73 () {64 vars in 1333 bytes} [Thu Aug 4 21:33:34 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:37.061302 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-5303c3ec-814c-4cf7-a1e0-11e826770032 admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:37.062259 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-5303c3ec-814c-4cf7-a1e0-11e826770032 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 04 21:33:37.062884 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 16/30] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 4 21:33:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:33:37.541736 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-d31be5d3-4ef3-4b35-9b53-84aebddde4a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "disk": 80, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192}} {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:38.430124 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG dbcounter [-] [121820] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=121820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:38.435814 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-d31be5d3-4ef3-4b35-9b53-84aebddde4a8 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.364849 Aug 04 21:33:38.436399 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 15/31] 10.222.0.73 () {64 vars in 1283 bytes} [Thu Aug 4 21:33:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:33:38.449375 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-83636f57-0ac6-42b6-92a7-ef8aef8c8089 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:38.556511 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-83636f57-0ac6-42b6-92a7-ef8aef8c8089 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110760 Aug 04 21:33:38.557090 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 17/32] 10.222.0.73 () {64 vars in 1333 bytes} [Thu Aug 4 21:33:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:40.957047 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-d31be5d3-4ef3-4b35-9b53-84aebddde4a8 admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:40.958076 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-d31be5d3-4ef3-4b35-9b53-84aebddde4a8 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 04 21:33:40.958486 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 16/33] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 4 21:33:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:33:41.398038 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-50b4a292-c769-402e-9a5d-b9de14aace88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:41.468232 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-50b4a292-c769-402e-9a5d-b9de14aace88 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.503835 Aug 04 21:33:41.469099 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 18/34] 10.222.0.73 () {64 vars in 1283 bytes} [Thu Aug 4 21:33:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:33:41.482197 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-cbe3b9df-94f4-402f-bd8c-e0e079286a57 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:41.620252 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-cbe3b9df-94f4-402f-bd8c-e0e079286a57 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.141976 Aug 04 21:33:41.634523 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 17/35] 10.222.0.73 () {64 vars in 1333 bytes} [Thu Aug 4 21:33:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:01.693584 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-50b4a292-c769-402e-9a5d-b9de14aace88 admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:01.694742 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-50b4a292-c769-402e-9a5d-b9de14aace88 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Aug 04 21:34:01.695142 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 19/36] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 4 21:34:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:34:02.086111 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-bded82b7-795a-48f7-950f-e4c7a0eb7372 admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:02.104016 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-bded82b7-795a-48f7-950f-e4c7a0eb7372 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402681 Aug 04 21:34:02.104489 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 18/37] 10.222.0.73 () {60 vars in 1292 bytes} [Thu Aug 4 21:34:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:34:03.179767 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-50b4a292-c769-402e-9a5d-b9de14aace88 admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:03.180770 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-50b4a292-c769-402e-9a5d-b9de14aace88 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 04 21:34:03.181166 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 20/38] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 4 21:34:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:34:03.705925 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-d1b7e836-42f2-415a-bff6-50dc93d120df admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:03.712075 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.wsgi [None req-d1b7e836-42f2-415a-bff6-50dc93d120df admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-d1b7e836-42f2-415a-bff6-50dc93d120df admin admin] Request method failure captured: Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Accept: application/json Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Accept-Encoding: gzip, deflate Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Connection: keep-alive Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Content-Length: 0 Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Host: 10.222.0.73 Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Openstack-Api-Version: compute 2.90 Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Openstack-System-Scope: None Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: User-Agent: python-novaclient Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Auth-Token: gAAAAABi7DtLROs5G3WKmLIUDhtc39pTNqI4nVHpUhwcNBBs5hawMfvq7GpDHZp5Ot5voTu5UJhZ2E1_JvCNiZg5wqlO1YqP5-vGGlgJrg75JLQckmvr5aFDePYmBg42U01X5j7O7398Voqzej3-mxxuzVmfGMEVAKH-VZ9kx9WZkH7hhoJC6vs Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Domain-Id: None Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Domain-Name: None Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Identity-Status: Confirmed Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Is-Admin-Project: True Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Project-Domain-Id: default Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Project-Domain-Name: Default Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Project-Id: 1a7e2e1e30694bd4b3a5931f10dc9fa8 Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Project-Name: admin Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Role: admin,reader,member Aug 04 21:34:03.715388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Roles: admin,reader,member Aug 04 21:34:03.717071 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1a7e2e1e30694bd4b3a5931f10dc9fa8", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1a7e2e1e30694bd4b3a5931f10dc9fa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1a7e2e1e30694bd4b3a5931f10dc9fa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1a7e2e1e30694bd4b3a5931f10dc9fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:34:03.717071 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Tenant: admin Aug 04 21:34:03.717071 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Tenant-Id: 1a7e2e1e30694bd4b3a5931f10dc9fa8 Aug 04 21:34:03.717071 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Tenant-Name: admin Aug 04 21:34:03.717071 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-User: admin Aug 04 21:34:03.717071 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-User-Domain-Id: default Aug 04 21:34:03.717071 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-User-Domain-Name: Default Aug 04 21:34:03.717071 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-User-Id: ec8458e10b6c4d69ba0ad246e923be31 Aug 04 21:34:03.717071 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-User-Name: admin Aug 04 21:34:03.717071 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: method: > Aug 04 21:34:03.717071 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: exception: Flavor 42 could not be found. Aug 04 21:34:03.717071 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: action_args: {'id': '42'} Aug 04 21:34:03.717071 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:34:03.717071 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:34:03.718074 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 21:34:03.718074 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 21:34:03.718074 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 21:34:03.718074 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 21:34:03.718074 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 21:34:03.718074 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 21:34:03.718074 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 21:34:03.718074 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 21:34:03.718074 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 21:34:03.718074 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:34:03.718074 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 21:34:03.718074 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 21:34:03.718074 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 21:34:03.718074 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Aug 04 21:34:03.718074 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:34:03.718074 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Aug 04 21:34:03.718074 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:34:03.718074 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:34:03.718074 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:34:03.719356 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:34:03.719356 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:34:03.719356 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:34:03.719356 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:34:03.719356 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 21:34:03.719356 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:34:03.719356 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 21:34:03.719356 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Aug 04 21:34:03.719356 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:34:03.719356 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Aug 04 21:34:03.719356 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:34:03.719356 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:34:03.719356 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:34:03.719356 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:34:03.719356 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:34:03.719356 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 21:34:03.719356 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Aug 04 21:34:03.719356 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-d1b7e836-42f2-415a-bff6-50dc93d120df admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=121820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:34:03.720433 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-d1b7e836-42f2-415a-bff6-50dc93d120df admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.398225 Aug 04 21:34:03.720433 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 19/39] 10.222.0.73 () {60 vars in 1190 bytes} [Thu Aug 4 21:34:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 21:34:03.727103 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-b39c87a0-1706-4c4a-b645-a1ad6becee40 admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:03.731211 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG dbcounter [-] [121821] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=121821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:34:03.749779 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-b39c87a0-1706-4c4a-b645-a1ad6becee40 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026249 Aug 04 21:34:03.750423 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 21/40] 10.222.0.73 () {60 vars in 1210 bytes} [Thu Aug 4 21:34:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:34:03.760441 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-31f3af43-8687-42f6-b621-9f312f447e61 admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:03.785132 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-31f3af43-8687-42f6-b621-9f312f447e61 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027727 Aug 04 21:34:03.785681 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 20/41] 10.222.0.73 () {60 vars in 1210 bytes} [Thu Aug 4 21:34:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:34:03.795498 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-88c7ff2f-b1cf-4cd6-b2d8-6766fa011b03 admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:03.801408 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.wsgi [None req-88c7ff2f-b1cf-4cd6-b2d8-6766fa011b03 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-88c7ff2f-b1cf-4cd6-b2d8-6766fa011b03 admin admin] Request method failure captured: Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Accept: application/json Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Accept-Encoding: gzip, deflate Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Connection: keep-alive Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Content-Length: 0 Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Host: 10.222.0.73 Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Openstack-Api-Version: compute 2.90 Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Openstack-System-Scope: None Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: User-Agent: python-novaclient Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Auth-Token: gAAAAABi7DtLROs5G3WKmLIUDhtc39pTNqI4nVHpUhwcNBBs5hawMfvq7GpDHZp5Ot5voTu5UJhZ2E1_JvCNiZg5wqlO1YqP5-vGGlgJrg75JLQckmvr5aFDePYmBg42U01X5j7O7398Voqzej3-mxxuzVmfGMEVAKH-VZ9kx9WZkH7hhoJC6vs Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Domain-Id: None Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Domain-Name: None Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Identity-Status: Confirmed Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Is-Admin-Project: True Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Project-Domain-Id: default Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Project-Domain-Name: Default Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Project-Id: 1a7e2e1e30694bd4b3a5931f10dc9fa8 Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Project-Name: admin Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Role: admin,reader,member Aug 04 21:34:03.804653 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Roles: admin,reader,member Aug 04 21:34:03.807677 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1a7e2e1e30694bd4b3a5931f10dc9fa8", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1a7e2e1e30694bd4b3a5931f10dc9fa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1a7e2e1e30694bd4b3a5931f10dc9fa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1a7e2e1e30694bd4b3a5931f10dc9fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:34:03.807677 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Tenant: admin Aug 04 21:34:03.807677 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Tenant-Id: 1a7e2e1e30694bd4b3a5931f10dc9fa8 Aug 04 21:34:03.807677 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Tenant-Name: admin Aug 04 21:34:03.807677 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-User: admin Aug 04 21:34:03.807677 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-User-Domain-Id: default Aug 04 21:34:03.807677 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-User-Domain-Name: Default Aug 04 21:34:03.807677 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-User-Id: ec8458e10b6c4d69ba0ad246e923be31 Aug 04 21:34:03.807677 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-User-Name: admin Aug 04 21:34:03.807677 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: method: > Aug 04 21:34:03.807677 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: exception: Flavor 42 could not be found. Aug 04 21:34:03.807677 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: action_args: {'id': '42'} Aug 04 21:34:03.807677 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:34:03.807677 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:34:03.808755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 21:34:03.808755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 21:34:03.808755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 21:34:03.808755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 21:34:03.808755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 21:34:03.808755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 21:34:03.808755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 21:34:03.808755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 21:34:03.808755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 21:34:03.808755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:34:03.808755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 21:34:03.808755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 21:34:03.808755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 21:34:03.808755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Aug 04 21:34:03.808755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:34:03.808755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Aug 04 21:34:03.808755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:34:03.808755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:34:03.808755 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:34:03.810068 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:34:03.810068 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:34:03.810068 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:34:03.810068 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:34:03.810068 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 21:34:03.810068 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:34:03.810068 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 21:34:03.810068 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Aug 04 21:34:03.810068 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:34:03.810068 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Aug 04 21:34:03.810068 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:34:03.810068 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:34:03.810068 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:34:03.810068 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:34:03.810068 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:34:03.810068 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 21:34:03.810068 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Aug 04 21:34:03.810068 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-88c7ff2f-b1cf-4cd6-b2d8-6766fa011b03 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=121821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:34:03.811355 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-88c7ff2f-b1cf-4cd6-b2d8-6766fa011b03 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014551 Aug 04 21:34:03.811355 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 22/42] 10.222.0.73 () {60 vars in 1190 bytes} [Thu Aug 4 21:34:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 21:34:04.774562 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-31f3af43-8687-42f6-b621-9f312f447e61 admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:04.775526 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-31f3af43-8687-42f6-b621-9f312f447e61 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Aug 04 21:34:04.775917 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 21/43] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 4 21:34:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:34:05.295014 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-368fbdbb-b3bb-472c-9de8-8c98e8761f08 admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:05.300261 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.wsgi [None req-368fbdbb-b3bb-472c-9de8-8c98e8761f08 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-368fbdbb-b3bb-472c-9de8-8c98e8761f08 admin admin] Request method failure captured: Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Accept: application/json Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Accept-Encoding: gzip, deflate Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Connection: keep-alive Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Content-Length: 0 Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Host: 10.222.0.73 Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Openstack-Api-Version: compute 2.90 Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Openstack-System-Scope: None Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: User-Agent: python-novaclient Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Auth-Token: gAAAAABi7DtMbkxAOIdmHAk0AolsBk4Jvn6xq0mybaW8GNWoXy0hehFu5MNodER9dF8Fgx4PDdjLx-khZXcH1JDNKiwuFCr55pGixeuv6JUeHDdTOV2Slr_eoaetoh7pP09RfqXZt9V4A_DX5CceftCS2cDBpxfZj0DXEo1YDZxPeiuaBHf_vsg Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Domain-Id: None Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Domain-Name: None Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Identity-Status: Confirmed Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Is-Admin-Project: True Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Project-Domain-Id: default Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Project-Domain-Name: Default Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Project-Id: 1a7e2e1e30694bd4b3a5931f10dc9fa8 Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Project-Name: admin Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Role: admin,reader,member Aug 04 21:34:05.301733 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Roles: admin,reader,member Aug 04 21:34:05.303281 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1a7e2e1e30694bd4b3a5931f10dc9fa8", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1a7e2e1e30694bd4b3a5931f10dc9fa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1a7e2e1e30694bd4b3a5931f10dc9fa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1a7e2e1e30694bd4b3a5931f10dc9fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:34:05.303281 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Tenant: admin Aug 04 21:34:05.303281 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Tenant-Id: 1a7e2e1e30694bd4b3a5931f10dc9fa8 Aug 04 21:34:05.303281 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Tenant-Name: admin Aug 04 21:34:05.303281 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-User: admin Aug 04 21:34:05.303281 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-User-Domain-Id: default Aug 04 21:34:05.303281 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-User-Domain-Name: Default Aug 04 21:34:05.303281 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-User-Id: ec8458e10b6c4d69ba0ad246e923be31 Aug 04 21:34:05.303281 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-User-Name: admin Aug 04 21:34:05.303281 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: method: > Aug 04 21:34:05.303281 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: exception: Flavor 84 could not be found. Aug 04 21:34:05.303281 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: action_args: {'id': '84'} Aug 04 21:34:05.303281 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:34:05.303281 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:34:05.304255 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 21:34:05.304255 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 21:34:05.304255 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 21:34:05.304255 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 21:34:05.304255 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 21:34:05.304255 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 21:34:05.304255 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 21:34:05.304255 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 21:34:05.304255 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 21:34:05.304255 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:34:05.304255 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 21:34:05.304255 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 21:34:05.304255 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 21:34:05.304255 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Aug 04 21:34:05.304255 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:34:05.304255 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Aug 04 21:34:05.304255 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:34:05.304255 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:34:05.304255 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:34:05.305687 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:34:05.305687 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:34:05.305687 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:34:05.305687 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:34:05.305687 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 21:34:05.305687 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:34:05.305687 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 21:34:05.305687 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Aug 04 21:34:05.305687 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:34:05.305687 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Aug 04 21:34:05.305687 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:34:05.305687 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:34:05.305687 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:34:05.305687 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:34:05.305687 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:34:05.305687 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 21:34:05.305687 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Aug 04 21:34:05.305687 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-368fbdbb-b3bb-472c-9de8-8c98e8761f08 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=121821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:34:05.306958 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-368fbdbb-b3bb-472c-9de8-8c98e8761f08 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.389668 Aug 04 21:34:05.306958 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 23/44] 10.222.0.73 () {60 vars in 1190 bytes} [Thu Aug 4 21:34:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 21:34:05.312730 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-f6939a75-03f1-44ea-acb8-1edd3582bd39 admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:05.327609 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-f6939a75-03f1-44ea-acb8-1edd3582bd39 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018426 Aug 04 21:34:05.328087 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 22/45] 10.222.0.73 () {60 vars in 1210 bytes} [Thu Aug 4 21:34:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:34:05.337775 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-290b1c09-1eea-4474-9620-86bbf8ce1814 admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:05.355010 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-290b1c09-1eea-4474-9620-86bbf8ce1814 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020654 Aug 04 21:34:05.355543 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 24/46] 10.222.0.73 () {60 vars in 1210 bytes} [Thu Aug 4 21:34:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:34:05.365484 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-6c24d40a-2608-463e-85b7-e903f942120b admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:05.370880 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.wsgi [None req-6c24d40a-2608-463e-85b7-e903f942120b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-6c24d40a-2608-463e-85b7-e903f942120b admin admin] Request method failure captured: Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Accept: application/json Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Accept-Encoding: gzip, deflate Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Connection: keep-alive Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Content-Length: 0 Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Host: 10.222.0.73 Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Openstack-Api-Version: compute 2.90 Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Openstack-System-Scope: None Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: User-Agent: python-novaclient Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Auth-Token: gAAAAABi7DtMbkxAOIdmHAk0AolsBk4Jvn6xq0mybaW8GNWoXy0hehFu5MNodER9dF8Fgx4PDdjLx-khZXcH1JDNKiwuFCr55pGixeuv6JUeHDdTOV2Slr_eoaetoh7pP09RfqXZt9V4A_DX5CceftCS2cDBpxfZj0DXEo1YDZxPeiuaBHf_vsg Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Domain-Id: None Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Domain-Name: None Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Identity-Status: Confirmed Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Is-Admin-Project: True Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Project-Domain-Id: default Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Project-Domain-Name: Default Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Project-Id: 1a7e2e1e30694bd4b3a5931f10dc9fa8 Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Project-Name: admin Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Role: admin,reader,member Aug 04 21:34:05.372383 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Roles: admin,reader,member Aug 04 21:34:05.373885 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1a7e2e1e30694bd4b3a5931f10dc9fa8", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1a7e2e1e30694bd4b3a5931f10dc9fa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1a7e2e1e30694bd4b3a5931f10dc9fa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1a7e2e1e30694bd4b3a5931f10dc9fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:34:05.373885 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Tenant: admin Aug 04 21:34:05.373885 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Tenant-Id: 1a7e2e1e30694bd4b3a5931f10dc9fa8 Aug 04 21:34:05.373885 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Tenant-Name: admin Aug 04 21:34:05.373885 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-User: admin Aug 04 21:34:05.373885 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-User-Domain-Id: default Aug 04 21:34:05.373885 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-User-Domain-Name: Default Aug 04 21:34:05.373885 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-User-Id: ec8458e10b6c4d69ba0ad246e923be31 Aug 04 21:34:05.373885 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-User-Name: admin Aug 04 21:34:05.373885 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: method: > Aug 04 21:34:05.373885 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: exception: Flavor 84 could not be found. Aug 04 21:34:05.373885 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: action_args: {'id': '84'} Aug 04 21:34:05.373885 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:34:05.373885 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:34:05.374926 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 21:34:05.374926 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 21:34:05.374926 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 21:34:05.374926 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 21:34:05.374926 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 21:34:05.374926 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 21:34:05.374926 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 21:34:05.374926 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 21:34:05.374926 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 21:34:05.374926 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:34:05.374926 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 21:34:05.374926 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 21:34:05.374926 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 21:34:05.374926 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Aug 04 21:34:05.374926 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:34:05.374926 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Aug 04 21:34:05.374926 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:34:05.374926 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:34:05.374926 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:34:05.376079 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:34:05.376079 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:34:05.376079 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:34:05.376079 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:34:05.376079 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 21:34:05.376079 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:34:05.376079 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 21:34:05.376079 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Aug 04 21:34:05.376079 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:34:05.376079 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Aug 04 21:34:05.376079 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:34:05.376079 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:34:05.376079 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:34:05.376079 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:34:05.376079 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:34:05.376079 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 21:34:05.376079 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Aug 04 21:34:05.376079 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-6c24d40a-2608-463e-85b7-e903f942120b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=121820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:34:05.377197 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-6c24d40a-2608-463e-85b7-e903f942120b admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012220 Aug 04 21:34:05.377197 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 23/47] 10.222.0.73 () {60 vars in 1190 bytes} [Thu Aug 4 21:34:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 21:34:06.348796 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-290b1c09-1eea-4474-9620-86bbf8ce1814 admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:06.349724 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-290b1c09-1eea-4474-9620-86bbf8ce1814 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 04 21:34:06.350145 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 25/48] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 4 21:34:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:34:06.879744 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-4500804e-9736-420c-8b3b-7e4ef11b974b admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:06.885435 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.wsgi [None req-4500804e-9736-420c-8b3b-7e4ef11b974b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-4500804e-9736-420c-8b3b-7e4ef11b974b admin admin] Request method failure captured: Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Accept: application/json Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Accept-Encoding: gzip, deflate Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Connection: keep-alive Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Content-Length: 0 Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Host: 10.222.0.73 Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Openstack-Api-Version: compute 2.90 Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Openstack-System-Scope: None Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: User-Agent: python-novaclient Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Auth-Token: gAAAAABi7DtOO6iLWooYk7V_XmaR9hE4nuCnglioxQHeh1V-cfhRQ8oQ2NnPnJZgopAZ3xzFQV4ymuEvtmZ690J5KeiKxGngWDGBJIlRWQQwquoXkO2GhJoaOvleOw9LRMYaju1P6ttyX81if5N4tac-sbWryaElV915ND_ryU0Lp4J7rW31er8 Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Domain-Id: None Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Domain-Name: None Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Identity-Status: Confirmed Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Is-Admin-Project: True Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Project-Domain-Id: default Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Project-Domain-Name: Default Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Project-Id: 1a7e2e1e30694bd4b3a5931f10dc9fa8 Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Project-Name: admin Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Role: admin,reader,member Aug 04 21:34:06.886959 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Roles: admin,reader,member Aug 04 21:34:06.888406 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1a7e2e1e30694bd4b3a5931f10dc9fa8", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1a7e2e1e30694bd4b3a5931f10dc9fa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1a7e2e1e30694bd4b3a5931f10dc9fa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1a7e2e1e30694bd4b3a5931f10dc9fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:34:06.888406 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Tenant: admin Aug 04 21:34:06.888406 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Tenant-Id: 1a7e2e1e30694bd4b3a5931f10dc9fa8 Aug 04 21:34:06.888406 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-Tenant-Name: admin Aug 04 21:34:06.888406 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-User: admin Aug 04 21:34:06.888406 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-User-Domain-Id: default Aug 04 21:34:06.888406 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-User-Domain-Name: Default Aug 04 21:34:06.888406 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-User-Id: ec8458e10b6c4d69ba0ad246e923be31 Aug 04 21:34:06.888406 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: X-User-Name: admin Aug 04 21:34:06.888406 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: method: > Aug 04 21:34:06.888406 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: exception: Flavor 451 could not be found. Aug 04 21:34:06.888406 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: action_args: {'id': '451'} Aug 04 21:34:06.888406 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:34:06.888406 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:34:06.889253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 21:34:06.889253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 21:34:06.889253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 21:34:06.889253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 21:34:06.889253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 21:34:06.889253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 21:34:06.889253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 21:34:06.889253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 21:34:06.889253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 21:34:06.889253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:34:06.889253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 21:34:06.889253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 21:34:06.889253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 21:34:06.889253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Aug 04 21:34:06.889253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:34:06.889253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Aug 04 21:34:06.889253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:34:06.889253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:34:06.889253 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:34:06.890967 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:34:06.890967 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:34:06.890967 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:34:06.890967 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:34:06.890967 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 21:34:06.890967 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:34:06.890967 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 21:34:06.890967 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Aug 04 21:34:06.890967 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:34:06.890967 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Aug 04 21:34:06.890967 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:34:06.890967 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:34:06.890967 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:34:06.890967 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:34:06.890967 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:34:06.890967 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 21:34:06.890967 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: ERROR nova.api.openstack.wsgi Aug 04 21:34:06.890967 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-4500804e-9736-420c-8b3b-7e4ef11b974b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=121820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:34:06.892312 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-4500804e-9736-420c-8b3b-7e4ef11b974b admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.400795 Aug 04 21:34:06.892312 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 24/49] 10.222.0.73 () {60 vars in 1193 bytes} [Thu Aug 4 21:34:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 21:34:06.898889 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-06144e58-13e9-4863-b1dc-3dd9315d6d3b admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:06.915053 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-06144e58-13e9-4863-b1dc-3dd9315d6d3b admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019759 Aug 04 21:34:06.915583 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 26/50] 10.222.0.73 () {60 vars in 1210 bytes} [Thu Aug 4 21:34:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:34:06.924940 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-8e8d9aaa-9994-43ad-9e24-cc1273245bf4 admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:06.939954 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-8e8d9aaa-9994-43ad-9e24-cc1273245bf4 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018536 Aug 04 21:34:06.940489 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 25/51] 10.222.0.73 () {60 vars in 1210 bytes} [Thu Aug 4 21:34:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:34:06.949505 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-d7722c81-1d93-4bc8-b4ef-e968bbcf4be7 admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:06.954730 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.wsgi [None req-d7722c81-1d93-4bc8-b4ef-e968bbcf4be7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-d7722c81-1d93-4bc8-b4ef-e968bbcf4be7 admin admin] Request method failure captured: Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Accept: application/json Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Accept-Encoding: gzip, deflate Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Connection: keep-alive Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Content-Length: 0 Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Host: 10.222.0.73 Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Openstack-Api-Version: compute 2.90 Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Openstack-System-Scope: None Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: User-Agent: python-novaclient Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Auth-Token: gAAAAABi7DtOO6iLWooYk7V_XmaR9hE4nuCnglioxQHeh1V-cfhRQ8oQ2NnPnJZgopAZ3xzFQV4ymuEvtmZ690J5KeiKxGngWDGBJIlRWQQwquoXkO2GhJoaOvleOw9LRMYaju1P6ttyX81if5N4tac-sbWryaElV915ND_ryU0Lp4J7rW31er8 Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Domain-Id: None Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Domain-Name: None Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Identity-Status: Confirmed Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Is-Admin-Project: True Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Project-Domain-Id: default Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Project-Domain-Name: Default Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Project-Id: 1a7e2e1e30694bd4b3a5931f10dc9fa8 Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Project-Name: admin Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Role: admin,reader,member Aug 04 21:34:06.956839 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Roles: admin,reader,member Aug 04 21:34:06.958570 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1a7e2e1e30694bd4b3a5931f10dc9fa8", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1a7e2e1e30694bd4b3a5931f10dc9fa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1a7e2e1e30694bd4b3a5931f10dc9fa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1a7e2e1e30694bd4b3a5931f10dc9fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:34:06.958570 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Tenant: admin Aug 04 21:34:06.958570 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Tenant-Id: 1a7e2e1e30694bd4b3a5931f10dc9fa8 Aug 04 21:34:06.958570 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-Tenant-Name: admin Aug 04 21:34:06.958570 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-User: admin Aug 04 21:34:06.958570 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-User-Domain-Id: default Aug 04 21:34:06.958570 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-User-Domain-Name: Default Aug 04 21:34:06.958570 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-User-Id: ec8458e10b6c4d69ba0ad246e923be31 Aug 04 21:34:06.958570 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: X-User-Name: admin Aug 04 21:34:06.958570 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: method: > Aug 04 21:34:06.958570 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: exception: Flavor 451 could not be found. Aug 04 21:34:06.958570 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: action_args: {'id': '451'} Aug 04 21:34:06.958570 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:34:06.958570 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:34:06.959767 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 21:34:06.959767 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 21:34:06.959767 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 21:34:06.959767 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 21:34:06.959767 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 21:34:06.959767 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 21:34:06.959767 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 21:34:06.959767 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 21:34:06.959767 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 21:34:06.959767 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:34:06.959767 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 21:34:06.959767 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 21:34:06.959767 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 21:34:06.959767 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Aug 04 21:34:06.959767 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:34:06.959767 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Aug 04 21:34:06.959767 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:34:06.959767 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:34:06.959767 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:34:06.961104 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:34:06.961104 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:34:06.961104 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:34:06.961104 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:34:06.961104 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 21:34:06.961104 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:34:06.961104 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 21:34:06.961104 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Aug 04 21:34:06.961104 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:34:06.961104 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Aug 04 21:34:06.961104 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:34:06.961104 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:34:06.961104 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:34:06.961104 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:34:06.961104 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:34:06.961104 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 21:34:06.961104 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: ERROR nova.api.openstack.wsgi Aug 04 21:34:06.961104 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-d7722c81-1d93-4bc8-b4ef-e968bbcf4be7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=121821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:34:06.962388 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-d7722c81-1d93-4bc8-b4ef-e968bbcf4be7 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012142 Aug 04 21:34:06.962388 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 27/52] 10.222.0.73 () {60 vars in 1193 bytes} [Thu Aug 4 21:34:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 21:34:07.934299 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-8e8d9aaa-9994-43ad-9e24-cc1273245bf4 admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:07.935298 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-8e8d9aaa-9994-43ad-9e24-cc1273245bf4 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 04 21:34:07.935689 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 26/53] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 4 21:34:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:34:08.460976 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-d34bf59a-b5cf-4f05-9812-bf3820026125 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:34:08.539563 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-d34bf59a-b5cf-4f05-9812-bf3820026125 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.463328 Aug 04 21:34:08.540112 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 28/54] 10.222.0.73 () {64 vars in 1235 bytes} [Thu Aug 4 21:34:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:34:09.539981 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-8e8d9aaa-9994-43ad-9e24-cc1273245bf4 admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:09.540988 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-8e8d9aaa-9994-43ad-9e24-cc1273245bf4 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 04 21:34:09.541388 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 27/55] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 4 21:34:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:34:10.068891 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-b6bb4014-f31d-4676-a675-3291f53bb19c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:34:10.162912 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-b6bb4014-f31d-4676-a675-3291f53bb19c admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.482297 Aug 04 21:34:10.163475 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 29/56] 10.222.0.73 () {64 vars in 1235 bytes} [Thu Aug 4 21:34:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:34:11.151048 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-8e8d9aaa-9994-43ad-9e24-cc1273245bf4 admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:11.152051 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-8e8d9aaa-9994-43ad-9e24-cc1273245bf4 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 04 21:34:11.152438 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 28/57] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 4 21:34:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:34:11.672568 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-f17a29fc-bf8c-45a2-aafe-0ab0acf12a8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:34:11.779181 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-f17a29fc-bf8c-45a2-aafe-0ab0acf12a8f admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.488559 Aug 04 21:34:11.779719 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 30/58] 10.222.0.73 () {64 vars in 1235 bytes} [Thu Aug 4 21:34:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:34:12.749068 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-8e8d9aaa-9994-43ad-9e24-cc1273245bf4 admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:12.750119 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-8e8d9aaa-9994-43ad-9e24-cc1273245bf4 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 04 21:34:12.750530 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 29/59] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 4 21:34:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:34:13.273554 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-59e6b1de-7f4b-4ad5-9686-9d640d3fb496 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:34:13.373438 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-59e6b1de-7f4b-4ad5-9686-9d640d3fb496 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.484711 Aug 04 21:34:13.373991 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 31/60] 10.222.0.73 () {64 vars in 1235 bytes} [Thu Aug 4 21:34:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 21:34:14.338328 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-8e8d9aaa-9994-43ad-9e24-cc1273245bf4 admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:14.339341 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-8e8d9aaa-9994-43ad-9e24-cc1273245bf4 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Aug 04 21:34:14.339769 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 30/61] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 4 21:34:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:34:14.865095 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-ec5da80e-a3b8-4803-80a3-9a84fe1d9888 admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:14.885613 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-ec5da80e-a3b8-4803-80a3-9a84fe1d9888 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.403474 Aug 04 21:34:14.886182 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 32/62] 10.222.0.73 () {60 vars in 1202 bytes} [Thu Aug 4 21:34:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:35:06.293803 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-8e8d9aaa-9994-43ad-9e24-cc1273245bf4 admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:06.294840 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-8e8d9aaa-9994-43ad-9e24-cc1273245bf4 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 04 21:35:06.295249 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 31/63] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 4 21:35:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:35:06.305701 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG dbcounter [-] [121821] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=121821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:35:06.685046 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-9007551f-eb1d-4aad-aab5-0dc2f1aba986 admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:06.706336 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-9007551f-eb1d-4aad-aab5-0dc2f1aba986 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404955 Aug 04 21:35:06.706814 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 33/64] 10.222.0.73 () {60 vars in 1292 bytes} [Thu Aug 4 21:35:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:35:06.730622 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-211286f6-29e5-407b-81dd-a39f1922a9e2 admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:06.734515 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG dbcounter [-] [121820] Writing DB stats nova_api:SELECT=21,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=121820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:35:06.739998 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-211286f6-29e5-407b-81dd-a39f1922a9e2 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013272 Aug 04 21:35:06.740519 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 32/65] 10.222.0.73 () {60 vars in 1283 bytes} [Thu Aug 4 21:35:06 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:35:06.752319 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-22b0fbfc-2439-49a5-9a05-96386222c0eb admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:06.760121 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-22b0fbfc-2439-49a5-9a05-96386222c0eb admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011631 Aug 04 21:35:06.760632 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 34/66] 10.222.0.73 () {60 vars in 1286 bytes} [Thu Aug 4 21:35:06 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:06.773151 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-c924c52a-bfc8-4764-8439-9e10a11591bf admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:06.782588 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-c924c52a-bfc8-4764-8439-9e10a11591bf admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012446 Aug 04 21:35:06.783154 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 33/67] 10.222.0.73 () {60 vars in 1286 bytes} [Thu Aug 4 21:35:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:06.794998 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-fbbe1657-bbce-4f6a-945e-156955fc4e5d admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:06.803075 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-fbbe1657-bbce-4f6a-945e-156955fc4e5d admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011707 Aug 04 21:35:06.803603 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 35/68] 10.222.0.73 () {60 vars in 1283 bytes} [Thu Aug 4 21:35:06 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:38:17.014119 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-c924c52a-bfc8-4764-8439-9e10a11591bf admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:38:17.015154 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-c924c52a-bfc8-4764-8439-9e10a11591bf admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 04 21:38:17.015542 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 34/69] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 4 21:38:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:38:17.160107 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG dbcounter [-] [121821] Writing DB stats nova_api:SELECT=6 {{(pid=121821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:38:17.325714 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-3823cda9-66eb-4965-b6ab-eaf0f916bc4c admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:38:17.328078 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:38:17.328078 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: warnings.warn(msg) Aug 04 21:38:17.329195 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-3823cda9-66eb-4965-b6ab-eaf0f916bc4c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:38:17.329726 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-3823cda9-66eb-4965-b6ab-eaf0f916bc4c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:38:17.330201 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-3823cda9-66eb-4965-b6ab-eaf0f916bc4c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:38:17.330919 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-3823cda9-66eb-4965-b6ab-eaf0f916bc4c admin admin] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:38:17.331367 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-3823cda9-66eb-4965-b6ab-eaf0f916bc4c admin admin] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:38:17.331808 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-3823cda9-66eb-4965-b6ab-eaf0f916bc4c admin admin] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:38:17.368857 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-3823cda9-66eb-4965-b6ab-eaf0f916bc4c admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.210206 Aug 04 21:38:17.369509 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 36/70] 10.222.0.73 () {60 vars in 1193 bytes} [Thu Aug 4 21:38:17 2022] GET /compute/v2.1/os-services => generated 791 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:38:18.194540 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-c924c52a-bfc8-4764-8439-9e10a11591bf admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:38:18.195548 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-c924c52a-bfc8-4764-8439-9e10a11591bf admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 04 21:38:18.195937 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 35/71] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 4 21:38:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:38:18.388803 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-2f583870-9415-49b8-806b-6367bf8e3919 admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:38:18.391218 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:38:18.391218 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: warnings.warn(msg) Aug 04 21:38:18.392325 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-2f583870-9415-49b8-806b-6367bf8e3919 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:38:18.392804 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-2f583870-9415-49b8-806b-6367bf8e3919 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:38:18.393235 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-2f583870-9415-49b8-806b-6367bf8e3919 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:38:18.393952 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-2f583870-9415-49b8-806b-6367bf8e3919 admin admin] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:38:18.394437 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-2f583870-9415-49b8-806b-6367bf8e3919 admin admin] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:38:18.394858 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-2f583870-9415-49b8-806b-6367bf8e3919 admin admin] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:38:18.414347 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-2f583870-9415-49b8-806b-6367bf8e3919 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077824 Aug 04 21:38:18.414837 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 37/72] 10.222.0.73 () {60 vars in 1193 bytes} [Thu Aug 4 21:38:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:38:29.683716 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-c924c52a-bfc8-4764-8439-9e10a11591bf admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:38:29.685354 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-c924c52a-bfc8-4764-8439-9e10a11591bf admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001791 Aug 04 21:38:29.685918 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 36/73] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 4 21:38:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:38:29.829859 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG dbcounter [-] [121821] Writing DB stats nova_cell0:SELECT=4 {{(pid=121821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:38:29.830547 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG dbcounter [-] [121821] Writing DB stats nova_cell1:SELECT=4 {{(pid=121821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:38:29.831185 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG dbcounter [-] [121821] Writing DB stats nova_api:SELECT=8 {{(pid=121821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:38:29.879386 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-7830e639-e5f4-4db7-bd6b-d0ffed481e15 admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:38:29.881822 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:38:29.881822 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: warnings.warn(msg) Aug 04 21:38:29.882966 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-7830e639-e5f4-4db7-bd6b-d0ffed481e15 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:38:29.883442 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-7830e639-e5f4-4db7-bd6b-d0ffed481e15 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:38:29.883868 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-7830e639-e5f4-4db7-bd6b-d0ffed481e15 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:38:29.884602 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-7830e639-e5f4-4db7-bd6b-d0ffed481e15 admin admin] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:38:29.885049 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-7830e639-e5f4-4db7-bd6b-d0ffed481e15 admin admin] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:38:29.885466 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-7830e639-e5f4-4db7-bd6b-d0ffed481e15 admin admin] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:38:29.910562 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-7830e639-e5f4-4db7-bd6b-d0ffed481e15 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085140 Aug 04 21:38:29.911121 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 38/74] 10.222.0.73 () {60 vars in 1193 bytes} [Thu Aug 4 21:38:29 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:38:30.733484 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: DEBUG nova.api.openstack.wsgi [None req-c924c52a-bfc8-4764-8439-9e10a11591bf admin admin] Calling method '>' {{(pid=121820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:38:30.734529 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: INFO nova.api.openstack.requestlog [None req-c924c52a-bfc8-4764-8439-9e10a11591bf admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 04 21:38:30.734930 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: [pid: 121820|app: 0|req: 37/75] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 4 21:38:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:38:30.927977 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG nova.api.openstack.wsgi [None req-8e93c63a-6a51-4d45-9614-02757c6e6f86 admin admin] Calling method '>' {{(pid=121821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:38:30.930385 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:38:30.930385 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: warnings.warn(msg) Aug 04 21:38:30.931473 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-8e93c63a-6a51-4d45-9614-02757c6e6f86 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:38:30.931939 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-8e93c63a-6a51-4d45-9614-02757c6e6f86 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:38:30.932360 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-8e93c63a-6a51-4d45-9614-02757c6e6f86 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:38:30.933098 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-8e93c63a-6a51-4d45-9614-02757c6e6f86 admin admin] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:38:30.933538 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-8e93c63a-6a51-4d45-9614-02757c6e6f86 admin admin] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:38:30.933946 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: DEBUG oslo_concurrency.lockutils [None req-8e93c63a-6a51-4d45-9614-02757c6e6f86 admin admin] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:38:30.956413 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: INFO nova.api.openstack.requestlog [None req-8e93c63a-6a51-4d45-9614-02757c6e6f86 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081376 Aug 04 21:38:30.956965 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: [pid: 121821|app: 0|req: 39/76] 10.222.0.73 () {60 vars in 1193 bytes} [Thu Aug 4 21:38:30 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:39:30.160581 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: Thu Aug 4 21:39:30 2022 - graceful shutdown triggered... Aug 04 21:39:30.160333 dv-cinder-852209-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 04 21:39:30.161566 dv-cinder-852209-1-iscsi devstack@n-api.service[121821]: Gracefully killing worker 2 (pid: 121821)... Aug 04 21:39:30.161940 dv-cinder-852209-1-iscsi devstack@n-api.service[121820]: Gracefully killing worker 1 (pid: 121820)... Aug 04 21:39:31.160810 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: worker 1 buried after 1 seconds Aug 04 21:39:31.161371 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: worker 2 buried after 1 seconds Aug 04 21:39:31.161371 dv-cinder-852209-1-iscsi devstack@n-api.service[121819]: goodbye to uWSGI. Aug 04 21:39:31.162389 dv-cinder-852209-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 04 21:39:31.162939 dv-cinder-852209-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 04 21:39:31.165691 dv-cinder-852209-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 21:39:31.175851 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 21:39:31.177812 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 21:39:31 2022] *** Aug 04 21:39:31.177812 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 21:39:31.177812 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 21:39:31.177812 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: nodename: dv-cinder-852209-1-iscsi Aug 04 21:39:31.177812 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: machine: x86_64 Aug 04 21:39:31.177812 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: clock source: unix Aug 04 21:39:31.177812 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: pcre jit disabled Aug 04 21:39:31.177812 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: detected number of CPU cores: 4 Aug 04 21:39:31.177812 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: current working directory: / Aug 04 21:39:31.177812 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: detected binary path: /usr/bin/uwsgi-core Aug 04 21:39:31.177812 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: your processes number limit is 47680 Aug 04 21:39:31.178790 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: your memory page size is 4096 bytes Aug 04 21:39:31.178790 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: detected max file descriptor number: 2048 Aug 04 21:39:31.178790 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: lock engine: pthread robust mutexes Aug 04 21:39:31.178790 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: thunder lock: enabled Aug 04 21:39:31.178790 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 21:39:31.178790 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 21:39:31.219614 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: Python main interpreter initialized at 0x560943e9c9c0 Aug 04 21:39:31.219614 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: python threads support enabled Aug 04 21:39:31.219614 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: your server socket listen backlog is limited to 100 connections Aug 04 21:39:31.219614 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: your mercy for graceful operations on workers is 90 seconds Aug 04 21:39:31.220040 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 21:39:31.220040 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: *** Operational MODE: preforking *** Aug 04 21:39:31.220933 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: *** uWSGI is running in multiple interpreter mode *** Aug 04 21:39:31.220933 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: spawned uWSGI master process (pid: 136318) Aug 04 21:39:31.220549 dv-cinder-852209-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 21:39:31.231525 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: spawned uWSGI worker 1 (pid: 136341, cores: 1) Aug 04 21:39:31.231525 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: spawned uWSGI worker 2 (pid: 136342, cores: 1) Aug 04 21:39:31.231525 dv-cinder-852209-1-iscsi devstack@n-api.service[136318]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 21:39:31.886574 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 21:39:31.892425 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 21:39:33.047894 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 21:39:33.047894 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: from cryptography.utils import int_from_bytes Aug 04 21:39:33.048630 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 21:39:33.048630 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: from cryptography.utils import int_from_bytes Aug 04 21:39:33.055722 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 21:39:33.055722 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: from cryptography.utils import int_from_bytes Aug 04 21:39:33.055722 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 21:39:33.055722 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: from cryptography.utils import int_from_bytes Aug 04 21:39:35.373866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 21:39:35.374473 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 21:39:35.374766 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 21:39:35.375049 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 21:39:35.375301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 21:39:35.375688 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.376015 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.376335 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.376658 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.376987 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.377295 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.377614 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.377930 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.378280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.378543 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.378857 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.379179 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-1-iscsi {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.379500 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.379803 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.380110 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.380424 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.380728 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.381003 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 21:39:35.381415 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.381501 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 21:39:35.381580 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.381776 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 21:39:35.381898 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.382180 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 21:39:35.383206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 21:39:35.383206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.383206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.383681 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.383831 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.384013 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.384167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.384358 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.384525 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.384724 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.384949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.385131 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.386062 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.386258 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.386404 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.386630 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.386797 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.386946 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-1-iscsi {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.387261 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.387463 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.387613 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.387950 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.388121 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.388121 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.388416 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.388569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.388721 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.388885 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.389041 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.389183 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.389500 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.389687 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-1-iscsi {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.389850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.389999 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.390292 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.390441 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.390589 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.390732 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.390906 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.391059 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.391213 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.391354 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.391501 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.391648 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.391790 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.391953 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.392095 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.392264 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.392420 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.392567 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.392718 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.392874 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.393021 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-1-iscsi {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.393171 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.393320 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.393806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.393969 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.393969 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.394315 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.394315 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.394582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.394582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.395073 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.395234 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.395377 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.395517 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.395665 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.395806 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.395979 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.396094 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.396181 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.396181 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.396338 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.396422 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.396841 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.396938 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.397029 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.397124 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.397208 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.397309 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.397519 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.397615 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.397695 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.397791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.397914 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.398034 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.398132 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.398416 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.398738 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.398830 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.398987 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.399140 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.399291 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.399470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.399610 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.399772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.399926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.400087 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.400244 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.400399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.400496 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.400751 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.400846 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.401069 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.401194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.401385 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.401513 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.401837 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.401926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.402185 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.402289 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.402495 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.402591 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.402800 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.402898 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.403103 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.403194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.403406 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.403496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.403714 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.403851 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.404017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.404125 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.404329 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.404431 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.404640 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.404729 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.404961 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.405052 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.405266 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.405370 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.405580 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.405678 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.405887 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.405987 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.406235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.406340 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.406539 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.406637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.406869 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.406971 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.407177 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.407279 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.407503 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.407611 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.407713 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.407795 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.408008 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.408112 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.408314 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.408418 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.408632 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.408734 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.408935 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.409033 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.409241 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.409331 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.409547 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.409645 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.409846 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.409943 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.410114 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.410218 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.410413 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.410512 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.410716 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.410807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.411029 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.411118 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.411331 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.411436 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.411701 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.411798 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.412010 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.412099 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.412313 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.412412 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.412644 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.412735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.412943 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.413041 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.413247 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.413350 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.413548 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.413639 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.413849 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.413962 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.414176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.414295 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.414477 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.414568 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.414784 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.414876 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.415084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.415182 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.415385 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.415483 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.415696 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.415792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.415996 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.416084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.416316 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.416429 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.416685 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.416815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.417001 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.417238 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.417376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.417465 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.417598 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.417715 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.417883 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.418047 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.418216 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.418358 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.418531 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.418726 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.418839 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.418958 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.419126 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.419270 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.419427 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.419571 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.419729 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.419871 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.420032 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.420183 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.420335 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.420478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.420636 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.420782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.420936 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.421098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.421243 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.421443 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.421565 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.421767 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.421848 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.422095 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.422192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.422433 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.422518 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.422738 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.422818 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.423053 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.423149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.423357 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.423454 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.423658 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.423772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.423948 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.424041 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.424251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.424353 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.424564 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.424653 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.424873 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.424962 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.425589 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.425700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.425786 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.425866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.425943 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:39:35.426170 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.426262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.426336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.426412 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.426498 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.426750 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.426841 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.427059 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.427140 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.427374 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.427525 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.427747 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.427841 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.428013 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.428176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.428326 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.428515 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.428628 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.428917 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.429027 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.429114 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.429235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.429454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.429560 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.429753 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.429853 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.430155 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.430261 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.430459 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.430565 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.430779 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.430904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.431141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.431245 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.431454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.431554 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.431768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.431867 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.432606 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.432731 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.432927 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.433179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.433371 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.433534 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.433709 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.433831 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.434090 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.434206 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.434445 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.434531 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.434758 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.434863 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.435085 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.435187 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.435397 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.435490 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.435705 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.435811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.436014 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.436118 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.436325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.436419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.436663 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.436765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.436968 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.437061 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.437274 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.437366 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.437587 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.437688 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.437909 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.438108 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.438244 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.438351 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.438569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.438670 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.438867 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.439005 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.439169 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.439291 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.439471 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.439580 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.439776 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.439956 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.440081 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.440181 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.440382 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.440472 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.440704 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.440795 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.441015 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.441119 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.441324 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.441424 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.441637 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.441729 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.441947 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.442069 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.442281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.442387 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.442589 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.442678 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.442899 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.442998 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.443205 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.443303 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.443516 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.443615 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.443826 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.443923 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.444132 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.444289 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.444473 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.444576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.444783 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.444891 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.445085 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.445184 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.445410 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.445509 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.445712 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.445809 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.446083 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.446189 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.446345 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.446435 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.446651 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.446741 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.446950 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.447049 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.447259 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.447350 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.447594 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.448251 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.448478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.448578 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.448798 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.448958 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.449114 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.449271 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.449450 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.449561 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.449781 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.449918 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.450112 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.450242 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.450441 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.450540 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.450765 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.450855 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.451080 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.451179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.451384 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.451473 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.451688 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.451786 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.451991 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.452095 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.452295 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.452384 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.452598 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.452688 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.452905 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.453005 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.453205 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.453294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.453507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.453608 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.453807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.453894 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.454133 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.454241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.454439 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.454590 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.454760 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.454866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.455060 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.455165 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.455359 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.455448 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.455659 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.455757 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.455958 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.456054 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.456255 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.456359 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.456561 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.456652 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.456862 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.456953 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.457162 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.457261 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.457461 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.457559 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.457761 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.457851 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.458090 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.458199 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.458459 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.458592 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.458778 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.458892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.459092 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.459198 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.459388 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.459732 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.460077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.460268 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.460434 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.460584 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.460733 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.460880 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.461049 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.461199 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.461356 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.461505 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.461653 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.461799 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.461957 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.462214 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.462319 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.462641 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.462947 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.463148 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.463302 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.463494 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.463651 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.464009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.464103 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.464299 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.464438 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.464623 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.464749 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.464937 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.465053 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.465252 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.465345 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.465565 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.465695 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.465878 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.465985 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.466305 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.466392 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.466618 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.466708 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.466938 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.467019 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.467258 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.467416 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.467580 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.467875 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.468058 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.468200 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.468464 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.468704 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.468857 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.468997 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.469142 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.469235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.469414 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.469566 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.469704 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.469795 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.469948 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.470136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.470289 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.470384 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.470602 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.470693 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.470925 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.471025 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.471226 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.471330 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.471532 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.471630 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.471855 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.471944 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.472186 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.472292 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.472435 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.472528 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.472744 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.472843 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.473047 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.473149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.473354 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.473442 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.473653 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.473742 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.473954 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.474162 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.474295 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.474394 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.474608 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.474718 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.474911 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.475118 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.475234 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.475369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.475511 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.475689 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.475832 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.475998 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.476141 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.476307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.476494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.476624 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.476817 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.476932 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.477127 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.477238 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.477430 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.477543 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.477752 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.477855 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.478079 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.478184 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.478382 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.478544 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.478679 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.478774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.479509 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.479663 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.479817 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.479920 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.480149 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.480272 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.480422 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.480509 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.480730 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.480837 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.481045 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.481141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.481350 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.481448 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.481664 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.481753 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.481973 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.482092 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.482317 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.482437 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.482606 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.482711 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.482924 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.483028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.483228 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.483320 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.483524 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.483618 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.483825 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.483918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.484126 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.484216 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.484431 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.484524 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.484754 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.484855 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.485056 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.485169 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.485363 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.485455 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.485673 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.485773 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.485976 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.486120 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.486314 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.486408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.486631 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.486725 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.486934 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.487215 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.487310 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.487549 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.487643 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.487853 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.487957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.488161 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.488255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.488467 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.488614 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.488772 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.488876 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.489078 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.489180 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.489397 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.489491 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.489702 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.489807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.490306 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.490488 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.490616 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.490817 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.490964 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.491109 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.491255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.491404 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.491555 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.491693 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.491836 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.492068 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.492217 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.492377 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.492504 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.492702 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.492853 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.492992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.493137 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.493275 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.493426 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.493566 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.493704 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.493811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.493893 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.494148 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.494372 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.494675 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.496086 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.496163 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.496250 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.496334 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.496406 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.496476 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.496546 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.496629 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.496709 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.496788 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.496871 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.496969 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.497069 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.497308 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.497483 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.497627 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.497711 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.497939 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.498095 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.498278 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.498369 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.498582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.498670 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.498886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.499200 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.499297 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.499372 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.499478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.499559 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.499794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.499900 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.500095 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.500190 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.500444 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.500543 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.500697 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.500780 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.501001 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.501079 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.501356 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.501554 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.501661 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.501741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.501899 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.501997 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.502232 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.502323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.502539 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.502639 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.502859 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.502967 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.503138 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.503230 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.503440 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.503541 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.503753 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.503923 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.504059 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.504235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.504379 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.504547 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.504659 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.504901 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.504993 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.505205 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.505307 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.505512 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.505612 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.505811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.505911 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.506132 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.506237 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.506437 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.506535 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.506736 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.506824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.507038 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.507143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.507341 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.507432 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.507645 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.507745 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.507966 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.508078 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.508240 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.508373 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.508561 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.508676 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.508970 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.509076 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.509172 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.509300 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.509433 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.509611 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.509744 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.509906 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.510104 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.510371 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.510530 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.510695 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.510860 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.511036 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.511200 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.511336 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.511475 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.511684 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.511772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.511991 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.512095 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.512303 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.512476 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.512590 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.512679 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.512915 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.513027 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.513233 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.513326 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.513536 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.513629 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.513853 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.513947 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.514190 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.514314 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.514497 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.514599 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.514803 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.514955 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.515124 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.515221 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.515430 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.515558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.515731 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.515823 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.516069 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.516255 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.516435 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.516575 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.516723 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.516869 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.517016 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.517154 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.517280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.517370 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.518066 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.518248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.518423 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.518582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.518733 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.518880 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.519026 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.519181 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.519335 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.519490 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.519738 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.519919 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.519919 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.520218 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.520372 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.520519 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.520663 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.520817 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.520962 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.521117 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.521270 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.521425 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.521571 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.522297 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.522468 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.522633 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.522781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.522947 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.523745 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.523910 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.524070 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.524218 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.524364 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.524510 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.524664 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.524819 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.524980 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.525133 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.525288 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.525434 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.525579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.525781 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.525978 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.526413 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.526784 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.527035 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.527285 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.527557 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.527829 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.528091 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.528350 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.528608 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.528868 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.529052 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.529215 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.529389 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.529389 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.529694 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.529694 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.530044 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.530236 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.530396 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.530396 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.530699 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.530875 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.531045 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.531205 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.531421 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.531597 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.531799 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.531981 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.532142 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.532312 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.532483 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.532653 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.532823 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.533001 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.533191 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.533354 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.533511 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.533511 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.533823 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.533995 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.534274 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.534433 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.534612 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.534772 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.534953 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.535109 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.535278 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.535446 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.535605 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.535763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.535948 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.536104 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.536300 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.536456 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.536922 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.537090 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.537266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.537443 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.537607 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.537772 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.537917 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.538109 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.538325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.538487 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.538633 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.538793 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.538946 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.539102 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.539250 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.539391 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.539532 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.539674 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.539816 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.539972 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.540117 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.540271 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.540414 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.540570 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.540722 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.540879 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.541021 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.541175 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.541831 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.541990 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.542211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.542369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.542537 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.542694 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.542865 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.543027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.543198 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.543356 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.543521 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.543685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.543685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.543685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.543685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.544249 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.544401 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.544550 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.544714 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.544883 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.545056 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.545222 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.545373 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.545535 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.545701 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.545971 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.546175 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.546175 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.546175 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.546616 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.546616 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.546616 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.547064 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.547216 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.547394 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.547550 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.547550 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.547805 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.547909 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.548013 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.548109 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.548205 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.548292 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.548376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.548469 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.548554 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.548645 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.548745 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.548839 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.548927 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.549009 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.549094 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.549094 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.549262 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.549356 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.549449 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.549534 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.549626 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.549718 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.549813 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.549898 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.549990 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.551142 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.551244 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.551350 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.551439 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.551524 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.551623 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.551717 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.551811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.551906 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.551990 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.552083 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.552169 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.552260 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.552349 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.552433 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.552526 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.552612 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.552704 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.552797 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.552892 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.552986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.553078 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.553164 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.553249 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.553328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.553410 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.553491 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.553563 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.553641 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.553727 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.553800 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.553898 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.553990 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.554108 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.554197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.554272 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.554352 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.554439 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.554521 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.554521 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.554667 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.554746 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.554833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.554930 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.555041 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.555241 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.555348 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.555567 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.555713 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.555899 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.555996 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.556233 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.556337 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.556554 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.556654 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.556855 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.557144 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.557742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.557827 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.558061 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.558231 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.558366 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.558627 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.558727 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.558979 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.559086 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.559263 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.559362 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.559563 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.559662 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.559863 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.559974 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.560165 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.560264 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.560469 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.560560 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.560774 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.560873 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.561083 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.561170 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.561386 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.561477 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.561690 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.561790 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.562026 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.562121 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.562359 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.562463 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.562667 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.562768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.562992 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.563084 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.563285 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.563390 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.563588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.563700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.563890 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.564078 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.564239 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.564391 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.564612 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.564767 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.564917 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.565074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.565216 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.565355 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.565505 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.565656 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.565816 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.565965 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.566141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.566293 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.566435 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.566576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.566735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.566834 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.566930 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.567027 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.567114 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.567234 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.567414 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.567549 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.567715 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.567864 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.568014 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.568172 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.568311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.568490 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.568646 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.568802 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.568946 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.569120 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.569272 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.569575 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.569679 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.569892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.569995 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.570233 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.570330 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.570542 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.570645 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.570855 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.570956 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.571244 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.571370 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.571560 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.571746 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.571911 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.572072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.572216 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.572307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.572459 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.572609 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.572798 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.572914 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.573109 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.573344 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.573453 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.573540 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.573846 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.573974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.574208 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.574312 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.574530 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.574870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.574976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.575062 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.575152 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.575237 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.575445 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.575582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.575801 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.575886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.576196 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.576297 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.576417 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.576507 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.576730 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.577047 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.577359 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.577532 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.577670 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.577854 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.577981 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.578222 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.578328 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.578546 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.578638 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.578873 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.578954 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.579271 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.579378 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.579515 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.579595 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.579826 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.579915 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.580161 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.580266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.580497 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.580788 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.581099 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.581413 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.581726 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.582285 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.582490 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.582650 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.582930 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.583094 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.583262 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.583419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.583571 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.583721 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.583876 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.584617 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.584810 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.584810 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.585238 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.585395 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.585552 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.585711 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.585870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.586108 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.586266 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.586416 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.586564 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.586721 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.586721 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.587121 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.587287 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.587287 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.587287 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.587719 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.587880 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.588037 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.588275 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.588571 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.588979 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.589206 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.589582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.589749 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.589749 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.590106 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.590273 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.590273 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.590557 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.590704 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.590852 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.591133 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.591302 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.591452 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.591728 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.591889 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.592058 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.592216 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.592430 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.592593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.592743 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.592898 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.593146 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.593316 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.593464 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.593621 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.593770 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.593918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.594119 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.594299 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.594465 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.594621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.594779 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.594941 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.595108 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.595359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.595513 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.595513 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.595829 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.596095 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.596261 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.596424 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.596582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.596738 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.596888 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.597036 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.597351 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.597518 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.597676 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.597825 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.597980 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.598170 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.598331 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.598480 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.598480 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.598884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.599041 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.599191 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.599412 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.599599 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.599599 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.599969 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.600127 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.600276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.600276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.600580 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.600730 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.600730 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.601024 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.601185 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.601341 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.601498 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.601653 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.601803 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.601950 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.602150 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.602308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.602497 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.602651 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.602808 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.602967 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.603144 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.603372 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.603527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.603677 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.604342 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.604507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.604507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.604813 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.604963 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.605111 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.605266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.605535 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.605712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.605863 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.606038 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.606205 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.606355 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.606518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.606667 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.606667 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.606968 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.607778 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.607952 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.608131 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.608387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.608557 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.608735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.608964 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.609128 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.609287 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.609436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.609585 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.609735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.609966 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.609966 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.610294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.610445 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.610620 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.610779 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.610945 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.610945 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.611252 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.611403 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.611552 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.611707 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.611863 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.612032 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.612181 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.612329 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.612532 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.612687 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.612853 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.612853 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.613149 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.613304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.613535 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.613693 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.613852 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.614028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.614196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.614347 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.614505 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.614671 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.614834 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.615236 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.615393 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.615566 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.615810 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.615974 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.616134 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.616324 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.616324 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.616613 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.616761 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.616923 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.617086 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.617236 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.617383 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.617540 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.617696 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.617696 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.618112 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.618268 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.618477 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.618633 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.618783 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.618958 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.619199 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.619356 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.620196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.620457 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.620625 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.620776 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.620926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.621082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.621232 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.621381 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.621381 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.621689 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.621838 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.622060 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.622236 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.622236 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.622545 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.622754 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.622905 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.623054 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.623208 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.623365 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.623365 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.623925 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.624096 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.624265 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.624416 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.624589 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.624746 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.624905 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.625061 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.625209 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.625357 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.625515 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.625680 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.625845 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.626113 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.626279 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.626441 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.626604 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.626762 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.626762 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.627052 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.627202 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.627363 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.627513 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.627668 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.627865 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.628099 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.628254 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.628427 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.628585 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.628735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.628884 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.629039 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.629354 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.629524 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.629675 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.629675 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.629966 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.630174 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.630324 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.630735 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.630735 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.631108 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.631259 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.631413 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.631575 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.631732 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.631884 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.632032 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.632180 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.632328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.632495 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.632687 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.632843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.633021 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.633178 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.633334 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.633497 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.633670 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.633902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.634074 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.634239 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.634399 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.634561 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.634561 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.634872 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.635056 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.635254 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.635417 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.635577 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.635735 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.635893 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.636043 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.636193 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.636451 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.636608 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.636765 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.636923 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.637091 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.637256 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.637415 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.637415 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.637722 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.637880 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.638056 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.638310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.638310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.638623 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.638773 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.638921 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.639069 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.639246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.639492 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.639649 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.639798 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.639947 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.640105 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.640105 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.640418 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.640587 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.640811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.640973 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.641133 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.641301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.641461 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.641618 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.641768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.641918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.642109 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.642109 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.642402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.642558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.642708 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.642906 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.643073 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.643231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.643396 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.643548 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.643696 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.643873 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.644105 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.644260 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.644418 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.644571 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.644737 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 21:39:35.644906 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.644906 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.644906 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.644906 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.644906 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.644906 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.644906 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.644906 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.646117 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.646117 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.646117 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.646117 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.646117 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.646979 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.646979 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.646979 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.647413 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.647413 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.647915 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.648236 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.648550 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.648851 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.649165 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.649595 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.649835 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.650174 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.650511 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.651055 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.651611 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.652271 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.652508 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.652852 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.653169 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.653489 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.653806 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.654196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.654473 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.654797 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.655381 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.655683 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.656012 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.656335 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.656826 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.656997 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.657320 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.657657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.658204 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.658581 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.658892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.659245 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.659584 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.659906 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.660225 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.660538 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:39:35.660786 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 21:39:35.796452 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO dbcounter [None req-3adc391c-083a-4354-8d52-9c4601ab2ece None None] Registered counter for database nova_api Aug 04 21:39:35.817210 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_db.sqlalchemy.engines [None req-3adc391c-083a-4354-8d52-9c4601ab2ece None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:39:35.820744 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO dbcounter [None req-968e4a55-db96-44a7-8632-e8a27324a48a None None] Registered counter for database nova_api Aug 04 21:39:35.824575 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writer thread running {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:39:35.841692 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_db.sqlalchemy.engines [None req-968e4a55-db96-44a7-8632-e8a27324a48a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:39:35.848424 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writer thread running {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:39:35.883653 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.context [None req-3adc391c-083a-4354-8d52-9c4601ab2ece None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4dbdb380-f63b-47cb-aa2b-0e711dd9c947(cell1) {{(pid=136341) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 21:39:35.887687 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3adc391c-083a-4354-8d52-9c4601ab2ece None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:35.888164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3adc391c-083a-4354-8d52-9c4601ab2ece None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:35.889773 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3adc391c-083a-4354-8d52-9c4601ab2ece None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:35.890523 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3adc391c-083a-4354-8d52-9c4601ab2ece None None] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:35.890969 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3adc391c-083a-4354-8d52-9c4601ab2ece None None] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:35.893003 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3adc391c-083a-4354-8d52-9c4601ab2ece None None] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:35.895062 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO dbcounter [None req-3adc391c-083a-4354-8d52-9c4601ab2ece None None] Registered counter for database nova_cell0 Aug 04 21:39:35.899135 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO dbcounter [None req-3adc391c-083a-4354-8d52-9c4601ab2ece None None] Registered counter for database nova_cell1 Aug 04 21:39:35.908077 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_db.sqlalchemy.engines [None req-3adc391c-083a-4354-8d52-9c4601ab2ece None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:39:35.908276 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.context [None req-968e4a55-db96-44a7-8632-e8a27324a48a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4dbdb380-f63b-47cb-aa2b-0e711dd9c947(cell1) {{(pid=136342) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 21:39:35.908784 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_db.sqlalchemy.engines [None req-3adc391c-083a-4354-8d52-9c4601ab2ece None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:39:35.912030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-968e4a55-db96-44a7-8632-e8a27324a48a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:35.913001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-968e4a55-db96-44a7-8632-e8a27324a48a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:35.914319 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-968e4a55-db96-44a7-8632-e8a27324a48a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:35.914471 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writer thread running {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:39:35.915095 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-968e4a55-db96-44a7-8632-e8a27324a48a None None] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:35.915479 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-968e4a55-db96-44a7-8632-e8a27324a48a None None] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:35.917553 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writer thread running {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:39:35.918135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-968e4a55-db96-44a7-8632-e8a27324a48a None None] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:35.920201 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO dbcounter [None req-968e4a55-db96-44a7-8632-e8a27324a48a None None] Registered counter for database nova_cell0 Aug 04 21:39:35.924388 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO dbcounter [None req-968e4a55-db96-44a7-8632-e8a27324a48a None None] Registered counter for database nova_cell1 Aug 04 21:39:35.931668 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_db.sqlalchemy.engines [None req-968e4a55-db96-44a7-8632-e8a27324a48a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:39:35.933506 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_db.sqlalchemy.engines [None req-968e4a55-db96-44a7-8632-e8a27324a48a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:39:35.939147 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writer thread running {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:39:35.941604 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writer thread running {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:39:36.063214 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO dbcounter [None req-3adc391c-083a-4354-8d52-9c4601ab2ece None None] Registered counter for database nova_cell0 Aug 04 21:39:36.069919 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_db.sqlalchemy.engines [None req-3adc391c-083a-4354-8d52-9c4601ab2ece None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:39:36.075188 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writer thread running {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:39:36.086379 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO dbcounter [None req-968e4a55-db96-44a7-8632-e8a27324a48a None None] Registered counter for database nova_cell0 Aug 04 21:39:36.093034 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_db.sqlalchemy.engines [None req-968e4a55-db96-44a7-8632-e8a27324a48a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:39:36.097412 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writer thread running {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:39:36.395503 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: WARNING keystonemiddleware.auth_token [None req-3adc391c-083a-4354-8d52-9c4601ab2ece None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 21:39:36.403231 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: WARNING keystonemiddleware.auth_token [None req-3adc391c-083a-4354-8d52-9c4601ab2ece None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 21:39:36.413931 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: WARNING keystonemiddleware.auth_token [None req-968e4a55-db96-44a7-8632-e8a27324a48a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 21:39:36.423188 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: WARNING keystonemiddleware.auth_token [None req-968e4a55-db96-44a7-8632-e8a27324a48a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 21:39:36.751586 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: WARNING keystonemiddleware.auth_token [None req-3adc391c-083a-4354-8d52-9c4601ab2ece None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 21:39:36.757917 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: WARNING keystonemiddleware.auth_token [None req-3adc391c-083a-4354-8d52-9c4601ab2ece None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 21:39:36.764826 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560943e9c9c0 pid: 136341 (default app) Aug 04 21:39:36.772862 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: WARNING keystonemiddleware.auth_token [None req-968e4a55-db96-44a7-8632-e8a27324a48a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 21:39:36.779739 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: WARNING keystonemiddleware.auth_token [None req-968e4a55-db96-44a7-8632-e8a27324a48a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 21:39:36.785969 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560943e9c9c0 pid: 136342 (default app) Aug 04 21:40:13.256167 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=3 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:40:13.256663 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=3 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:40:13.257037 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=3 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:40:13.257767 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=3 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:40:14.318752 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-88fa3aca-e246-478c-978f-5bf81ddfce52 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Action: 'create', calling method: .version_select at 0x7f3c126e4dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-451812959"}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:40:16.326928 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-88fa3aca-e246-478c-978f-5bf81ddfce52 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.084902 Aug 04 21:40:16.328017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 1/1] 10.222.0.73 () {60 vars in 1155 bytes} [Thu Aug 4 21:40:13 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3088 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 21:40:16.756521 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-94c3d7de-da0d-4f19-ad6a-f95f372cfea9 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Calling method '.version_select at 0x7f3c127b6940>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:16.804697 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=3 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:40:16.805797 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=3 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:40:16.807069 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=3 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:40:16.808436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=3 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:40:17.175889 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-eff8d35c-2cc7-4fe9-b6c2-9cb4257c4664 tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] Calling method '.version_select at 0x7f3c1255ec10>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:17.246311 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-eff8d35c-2cc7-4fe9-b6c2-9cb4257c4664 tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/00e8909f-982c-4a7b-9d9d-8b1f5f57f130" status: 200 len: 350 microversion: 2.1 time: 0.074577 Aug 04 21:40:17.247402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 2/2] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 4 21:40:17 2022] GET /compute/v2.1/os-volumes/00e8909f-982c-4a7b-9d9d-8b1f5f57f130 => generated 350 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:40:17.384361 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-94c3d7de-da0d-4f19-ad6a-f95f372cfea9 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/0d9e803d-586f-43e3-8606-762c986565ed" status: 200 len: 344 microversion: 2.1 time: 1.045294 Aug 04 21:40:17.384941 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 1/3] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 4 21:40:16 2022] GET /compute/v2.1/os-volumes/0d9e803d-586f-43e3-8606-762c986565ed => generated 344 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:40:18.398664 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-21024659-17d8-482c-8fb4-976211259c20 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Calling method '.version_select at 0x7f3c125723a0>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:18.525319 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-21024659-17d8-482c-8fb4-976211259c20 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/0d9e803d-586f-43e3-8606-762c986565ed" status: 200 len: 345 microversion: 2.1 time: 0.121493 Aug 04 21:40:18.525319 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 3/4] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 4 21:40:18 2022] GET /compute/v2.1/os-volumes/0d9e803d-586f-43e3-8606-762c986565ed => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:40:18.530585 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-117ce9ca-487f-4222-9fc4-6d8e867a2e73 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Action: 'create', calling method: .version_select at 0x7f3c1260ce50>, body: {"snapshot": {"volume_id": "0d9e803d-586f-43e3-8606-762c986565ed", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1087946407"}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:40:19.509000 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-117ce9ca-487f-4222-9fc4-6d8e867a2e73 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.982301 Aug 04 21:40:19.510049 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 2/5] 10.222.0.73 () {60 vars in 1162 bytes} [Thu Aug 4 21:40:18 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:40:19.538608 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-0001bdea-d177-4b02-a482-62571f4d2b09 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Calling method '.version_select at 0x7f3c12572a60>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:19.668685 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-0001bdea-d177-4b02-a482-62571f4d2b09 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23" status: 200 len: 287 microversion: 2.1 time: 0.149364 Aug 04 21:40:19.670053 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 4/6] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 4 21:40:19 2022] GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23 => generated 287 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:40:19.685034 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-9bbd5628-42f1-4374-8cb4-5f2dddccad98 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Calling method '.version_select at 0x7f3c1260cb80>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:19.804553 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-9bbd5628-42f1-4374-8cb4-5f2dddccad98 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.126800 Aug 04 21:40:19.805783 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 3/7] 10.222.0.73 () {58 vars in 1140 bytes} [Thu Aug 4 21:40:19 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:40:19.824463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-bede040c-9e40-4eef-8ca0-c8d988a01ed5 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Calling method '.version_select at 0x7f3c1255eca0>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:19.921470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-bede040c-9e40-4eef-8ca0-c8d988a01ed5 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23" status: 200 len: 287 microversion: 2.1 time: 0.106801 Aug 04 21:40:19.922894 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 5/8] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 4 21:40:19 2022] GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23 => generated 287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:40:20.421948 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d2225a88-30d4-486e-9427-be08e5522c43 tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] Calling method '.version_select at 0x7f3c1255ae50>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:20.545633 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d2225a88-30d4-486e-9427-be08e5522c43 tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/58f52c68-c5e3-4f8d-ad56-118b10aacef2" status: 200 len: 350 microversion: 2.1 time: 0.137301 Aug 04 21:40:20.551201 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 4/9] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 4 21:40:20 2022] GET /compute/v2.1/os-volumes/58f52c68-c5e3-4f8d-ad56-118b10aacef2 => generated 350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:40:20.937707 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2991f7ae-6fd6-48b7-ba2f-e36831863123 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Calling method '.version_select at 0x7f3c125729d0>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:20.989154 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2991f7ae-6fd6-48b7-ba2f-e36831863123 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23" status: 200 len: 287 microversion: 2.1 time: 0.057843 Aug 04 21:40:20.995727 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 6/10] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 4 21:40:20 2022] GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:40:22.004952 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ef67c60f-f0e6-4e87-91f0-fcb31e762ce3 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Calling method '.version_select at 0x7f3c125755e0>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:22.056030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ef67c60f-f0e6-4e87-91f0-fcb31e762ce3 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23" status: 200 len: 287 microversion: 2.1 time: 0.056443 Aug 04 21:40:22.062778 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 5/11] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 4 21:40:21 2022] GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:40:23.068714 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-610d19e6-2acb-4e69-ac5c-1a23f2d87bee tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Calling method '.version_select at 0x7f3c12572310>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:23.120656 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-610d19e6-2acb-4e69-ac5c-1a23f2d87bee tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23" status: 200 len: 287 microversion: 2.1 time: 0.055790 Aug 04 21:40:23.121220 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 7/12] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 4 21:40:23 2022] GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:40:24.135520 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-662fec11-b9e1-4b66-8962-14b8712eb1fc tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Calling method '.version_select at 0x7f3c1255a310>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:24.205328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-662fec11-b9e1-4b66-8962-14b8712eb1fc tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23" status: 200 len: 287 microversion: 2.1 time: 0.072388 Aug 04 21:40:24.205988 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 6/13] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 4 21:40:24 2022] GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:40:25.220514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-81b80a28-7b51-416f-9296-4fec17746aa5 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Calling method '.version_select at 0x7f3c1255eca0>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:25.313368 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-81b80a28-7b51-416f-9296-4fec17746aa5 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23" status: 200 len: 287 microversion: 2.1 time: 0.099154 Aug 04 21:40:25.319119 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 8/14] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 4 21:40:25 2022] GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23 => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:40:26.326799 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e636196b-9593-4902-8c3a-6790edb7aa8b tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Calling method '.version_select at 0x7f3c1255aa60>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:26.379761 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e636196b-9593-4902-8c3a-6790edb7aa8b tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23" status: 200 len: 287 microversion: 2.1 time: 0.057484 Aug 04 21:40:26.384648 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 7/15] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 4 21:40:26 2022] GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:40:27.287582 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-7240dfe9-5162-41b7-9e1e-9f4bd439b974 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Action: 'create', calling method: .version_select at 0x7f3c12572280>, body: {"keypair": {"name": "tempest-keypair-429370592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf/bHHFX9N31VQL/Yp7OecQIJUizEXWUz+QIlQHM5mFbSa0M2ANY5OojfSk/4uxnErDXRksiP6P9Qo2TnyJ95SfWioX/we0hJKjgdYDOZOquffj5/PzT44rqyJ9Bho5NA=="}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:40:27.366429 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-7240dfe9-5162-41b7-9e1e-9f4bd439b974 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Getting quotas for project 09370df0a2354bd2a412c6770d3ff165. Resources: {'key_pairs'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:40:27.376226 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-7240dfe9-5162-41b7-9e1e-9f4bd439b974 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Getting quotas for user a23fcabad2354e7ab51a22b412bf11e6 and project 09370df0a2354bd2a412c6770d3ff165. Resources: {'key_pairs'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:40:27.392620 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-0fd4d204-0316-49b7-9711-d6adbfc0a109 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Calling method '.version_select at 0x7f3c1260cb80>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:27.472092 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-0fd4d204-0316-49b7-9711-d6adbfc0a109 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23" status: 200 len: 288 microversion: 2.1 time: 0.083153 Aug 04 21:40:27.474783 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 8/16] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 4 21:40:27 2022] GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23 => generated 288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:40:27.487805 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-5226cbc7-65e4-476f-b7f5-e706494782ef tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Calling method '.version_select at 0x7f3c12575700>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:27.666173 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-7240dfe9-5162-41b7-9e1e-9f4bd439b974 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.697662 Aug 04 21:40:27.669845 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 9/17] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 4 21:40:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:40:27.766422 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-5226cbc7-65e4-476f-b7f5-e706494782ef tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "DELETE /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23" status: 202 len: 0 microversion: 2.1 time: 0.283814 Aug 04 21:40:27.767064 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 9/18] 10.222.0.73 () {58 vars in 1254 bytes} [Thu Aug 4 21:40:27 2022] DELETE /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 21:40:27.803833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ded30d86-6da4-4902-be67-bc836aab71cb tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Calling method '.version_select at 0x7f3c11cf5310>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:27.906365 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ded30d86-6da4-4902-be67-bc836aab71cb tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23" status: 200 len: 287 microversion: 2.1 time: 0.131648 Aug 04 21:40:27.906365 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 10/19] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 4 21:40:27 2022] GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23 => generated 287 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:40:28.234964 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-3f893463-cead-4d82-b554-3020cf400f11 tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] Calling method '.version_select at 0x7f3c1260c940>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:28.357247 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-3f893463-cead-4d82-b554-3020cf400f11 tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/05228d73-4c97-483a-80a7-3d0169e3476a" status: 200 len: 350 microversion: 2.1 time: 0.126502 Aug 04 21:40:28.357822 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 10/20] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 4 21:40:28 2022] GET /compute/v2.1/os-volumes/05228d73-4c97-483a-80a7-3d0169e3476a => generated 350 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:40:28.373879 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-936f780c-d66f-4bf0-a3be-3dc4fcdf8e59 tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] Calling method '.version_select at 0x7f3c12548dc0>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:28.527598 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-936f780c-d66f-4bf0-a3be-3dc4fcdf8e59 tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.158772 Aug 04 21:40:28.528192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 11/21] 10.222.0.73 () {58 vars in 1134 bytes} [Thu Aug 4 21:40:28 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:28.548614 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-75c85156-44f5-4cbb-88ac-b033cb252e81 tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] Calling method '.version_select at 0x7f3c1255ac10>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:28.707521 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-75c85156-44f5-4cbb-88ac-b033cb252e81 tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.167764 Aug 04 21:40:28.712783 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 11/22] 10.222.0.73 () {58 vars in 1149 bytes} [Thu Aug 4 21:40:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:40:28.723609 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-621eadd5-e882-4cd5-9e10-bafbf91a994d tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] Calling method '.version_select at 0x7f3c11d0c040>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:28.848770 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-621eadd5-e882-4cd5-9e10-bafbf91a994d tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.128469 Aug 04 21:40:28.859277 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 12/23] 10.222.0.73 () {58 vars in 1134 bytes} [Thu Aug 4 21:40:28 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:28.862883 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b4ae9950-4fc3-4963-ba44-a4e77b50de47 tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] Calling method '.version_select at 0x7f3c12575940>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:28.919728 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-da2ec5b6-9163-479a-84af-852c35832d8d tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Calling method '.version_select at 0x7f3c11cf5c10>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:29.052023 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-da2ec5b6-9163-479a-84af-852c35832d8d tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] HTTP exception thrown: Snapshot cac37148-0df1-4fde-84d7-a1b9c8573e23 could not be found. Aug 04 21:40:29.059238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-da2ec5b6-9163-479a-84af-852c35832d8d tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Request method failure captured: Aug 04 21:40:29.059238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23 HTTP/1.1 Aug 04 21:40:29.059238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:40:29.059238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:40:29.059238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:40:29.059238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 21:40:29.059238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:40:29.059238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:40:29.059238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:40:29.059238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:40:29.059238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7Dy9t1Dzg1mpiOpCViUO766qsZiAFmXjMzGdHLEaEa18Pptz9TJxemAsfVOssc8suGrIDF8e5zUZWs_NgEB_sy8A3yPVKg2w5f9pQyutn1HQYw4MsVGzoP5-OHWTyZ_rovL2OjQc8zd8Qq2F2J4793F1cR8r3Ytrn489GXw9p1rJm7E Aug 04 21:40:29.059238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:40:29.059238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:40:29.059238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:40:29.059238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:40:29.059238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:40:29.059238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:40:29.059238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: df5356c0de064c2e83109c058870efb1 Aug 04 21:40:29.059238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1955884183 Aug 04 21:40:29.059238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:40:29.059238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:40:29.060449 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_df5356c0de064c2e83109c058870efb1", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/df5356c0de064c2e83109c058870efb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/df5356c0de064c2e83109c058870efb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/df5356c0de064c2e83109c058870efb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:40:29.060449 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1955884183 Aug 04 21:40:29.060449 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: df5356c0de064c2e83109c058870efb1 Aug 04 21:40:29.060449 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1955884183 Aug 04 21:40:29.060449 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-VolumesSnapshotsTestJSON-1955884183-project Aug 04 21:40:29.060449 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:40:29.060449 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:40:29.060449 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: cd348c0520e246d5814e035349bf7b90 Aug 04 21:40:29.060449 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1955884183-project Aug 04 21:40:29.060449 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: Aug 04 21:40:29.060449 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Snapshot cac37148-0df1-4fde-84d7-a1b9c8573e23 could not be found. Aug 04 21:40:29.060449 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': 'cac37148-0df1-4fde-84d7-a1b9c8573e23'} Aug 04 21:40:29.060449 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:40:29.061122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:40:29.061122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 21:40:29.061122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 21:40:29.061122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 21:40:29.061122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 21:40:29.061122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 21:40:29.061122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 21:40:29.061122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:40:29.061122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:40:29.061122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:40:29.061122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:40:29.061122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:40:29.061122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:40:29.061122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:40:29.061122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:40:29.061122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cac37148-0df1-4fde-84d7-a1b9c8573e23 could not be found. (HTTP 404) (Request-ID: req-e1f973bc-5326-43d3-aaef-fbc7f7c16e3d) Aug 04 21:40:29.061122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:40:29.061122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:40:29.066577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:40:29.066577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:40:29.066577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 04 21:40:29.066577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 04 21:40:29.066577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:40:29.066577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:40:29.066577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 04 21:40:29.066577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 04 21:40:29.066577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:40:29.066577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:40:29.066577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 21:40:29.066577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 21:40:29.066577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 21:40:29.066577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 21:40:29.066577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 21:40:29.066577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 21:40:29.066577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:40:29.066577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:40:29.066577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:40:29.067504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:40:29.067504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:40:29.067504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:40:29.067504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:40:29.067504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:40:29.067504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cac37148-0df1-4fde-84d7-a1b9c8573e23 could not be found. Aug 04 21:40:29.067504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:40:29.067504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:40:29.067504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:40:29.067504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:40:29.067504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:40:29.067504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:40:29.067504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:40:29.067504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:40:29.067504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:40:29.067504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:40:29.067504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:40:29.067504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:40:29.067504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 04 21:40:29.067504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:40:29.068499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cac37148-0df1-4fde-84d7-a1b9c8573e23 could not be found. Aug 04 21:40:29.068499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:40:29.068499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:40:29.068499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:40:29.068499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:40:29.068499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:40:29.068499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:40:29.068499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:40:29.068499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:40:29.068499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cac37148-0df1-4fde-84d7-a1b9c8573e23 could not be found. Aug 04 21:40:29.068499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:40:29.068499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-da2ec5b6-9163-479a-84af-852c35832d8d tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Returning 404 to user: Snapshot cac37148-0df1-4fde-84d7-a1b9c8573e23 could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:40:29.068499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-da2ec5b6-9163-479a-84af-852c35832d8d tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23" status: 404 len: 111 microversion: 2.1 time: 0.150772 Aug 04 21:40:29.069139 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 13/24] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 4 21:40:28 2022] GET /compute/v2.1/os-snapshots/cac37148-0df1-4fde-84d7-a1b9c8573e23 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:40:29.083542 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f59e1f0a-352d-4c0b-bd17-da72ff3903fe tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Calling method '.version_select at 0x7f3c12ee51f0>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:29.166634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b4ae9950-4fc3-4963-ba44-a4e77b50de47 tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.307372 Aug 04 21:40:29.173521 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 12/25] 10.222.0.73 () {58 vars in 1167 bytes} [Thu Aug 4 21:40:28 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:40:29.192819 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ec64a97a-9132-46e0-b20c-ff4d869bc70a tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] Calling method '.version_select at 0x7f3c12575af0>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:29.500241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ec64a97a-9132-46e0-b20c-ff4d869bc70a tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.312418 Aug 04 21:40:29.501329 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 13/26] 10.222.0.73 () {58 vars in 1170 bytes} [Thu Aug 4 21:40:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:40:29.515812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f1a27a32-d197-4142-86c2-0698270f91b9 tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] Calling method '.version_select at 0x7f3c1255a8b0>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:29.558184 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f59e1f0a-352d-4c0b-bd17-da72ff3903fe tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/0d9e803d-586f-43e3-8606-762c986565ed" status: 202 len: 0 microversion: 2.1 time: 0.486565 Aug 04 21:40:29.559054 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 14/27] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 4 21:40:29 2022] DELETE /compute/v2.1/os-volumes/0d9e803d-586f-43e3-8606-762c986565ed => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:40:29.568608 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-96142399-7ae1-4744-b484-eda1b6a0dc05 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Calling method '.version_select at 0x7f3c11d0c790>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:29.707174 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-f1a27a32-d197-4142-86c2-0698270f91b9 tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.196387 Aug 04 21:40:29.708185 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 14/28] 10.222.0.73 () {58 vars in 1155 bytes} [Thu Aug 4 21:40:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:40:29.722740 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-70e636bc-2760-4132-a451-51e5b2cde150 tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] Calling method '.version_select at 0x7f3c125851f0>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:29.839025 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-96142399-7ae1-4744-b484-eda1b6a0dc05 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/0d9e803d-586f-43e3-8606-762c986565ed" status: 200 len: 344 microversion: 2.1 time: 0.275234 Aug 04 21:40:29.840280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 15/29] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 4 21:40:29 2022] GET /compute/v2.1/os-volumes/0d9e803d-586f-43e3-8606-762c986565ed => generated 344 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:40:30.037272 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-70e636bc-2760-4132-a451-51e5b2cde150 tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.318765 Aug 04 21:40:30.040270 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 15/30] 10.222.0.73 () {58 vars in 1188 bytes} [Thu Aug 4 21:40:29 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:40:30.056131 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-6e3c72b9-f009-459d-98a6-f8f675b17fcb tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] Calling method '.version_select at 0x7f3c11d0cf70>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:30.326815 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-6e3c72b9-f009-459d-98a6-f8f675b17fcb tempest-VolumesTestJSON-757193877 tempest-VolumesTestJSON-757193877-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.276147 Aug 04 21:40:30.327387 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 16/31] 10.222.0.73 () {58 vars in 1155 bytes} [Thu Aug 4 21:40:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:30.861341 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d2fe9495-2f5d-4685-b383-8e162ec08592 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Calling method '.version_select at 0x7f3c1255a790>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:30.939440 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-d2fe9495-2f5d-4685-b383-8e162ec08592 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] HTTP exception thrown: Volume 0d9e803d-586f-43e3-8606-762c986565ed could not be found. Aug 04 21:40:30.957447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d2fe9495-2f5d-4685-b383-8e162ec08592 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Request method failure captured: Aug 04 21:40:30.957447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: GET /compute/v2.1/os-volumes/0d9e803d-586f-43e3-8606-762c986565ed HTTP/1.1 Aug 04 21:40:30.957447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:40:30.957447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:40:30.957447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:40:30.957447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:40:30.957447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:40:30.957447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:40:30.957447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:40:30.957447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:40:30.957447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7Dy9t1Dzg1mpiOpCViUO766qsZiAFmXjMzGdHLEaEa18Pptz9TJxemAsfVOssc8suGrIDF8e5zUZWs_NgEB_sy8A3yPVKg2w5f9pQyutn1HQYw4MsVGzoP5-OHWTyZ_rovL2OjQc8zd8Qq2F2J4793F1cR8r3Ytrn489GXw9p1rJm7E Aug 04 21:40:30.957447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:40:30.957447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:40:30.957447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:40:30.957447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:40:30.957447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:40:30.957447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:40:30.957447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: df5356c0de064c2e83109c058870efb1 Aug 04 21:40:30.957447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1955884183 Aug 04 21:40:30.957447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:40:30.957447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:40:30.962815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_df5356c0de064c2e83109c058870efb1", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/df5356c0de064c2e83109c058870efb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/df5356c0de064c2e83109c058870efb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/df5356c0de064c2e83109c058870efb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:40:30.962815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1955884183 Aug 04 21:40:30.962815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: df5356c0de064c2e83109c058870efb1 Aug 04 21:40:30.962815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1955884183 Aug 04 21:40:30.962815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-VolumesSnapshotsTestJSON-1955884183-project Aug 04 21:40:30.962815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:40:30.962815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:40:30.962815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: cd348c0520e246d5814e035349bf7b90 Aug 04 21:40:30.962815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1955884183-project Aug 04 21:40:30.962815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: Aug 04 21:40:30.962815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Volume 0d9e803d-586f-43e3-8606-762c986565ed could not be found. Aug 04 21:40:30.962815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': '0d9e803d-586f-43e3-8606-762c986565ed'} Aug 04 21:40:30.962815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:40:30.965072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:40:30.965072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:40:30.965072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:40:30.965072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:40:30.965072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:40:30.965072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:40:30.965072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:40:30.965072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:40:30.965072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:40:30.965072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:40:30.965072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:40:30.965072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:40:30.965072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:40:30.965072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:40:30.965072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:40:30.965072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d9e803d-586f-43e3-8606-762c986565ed could not be found. (HTTP 404) (Request-ID: req-0426fb4b-e601-4af5-9719-2d70efcf8011) Aug 04 21:40:30.965072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:40:30.965072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:40:30.965072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:40:30.969240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:40:30.969240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 21:40:30.969240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 21:40:30.969240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:40:30.969240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:40:30.969240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 21:40:30.969240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 21:40:30.969240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:40:30.969240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:40:30.969240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:40:30.969240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:40:30.969240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:40:30.969240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:40:30.969240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:40:30.969240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:40:30.969240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:40:30.969240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:40:30.969240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:40:30.969240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:40:30.971794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:40:30.971794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:40:30.971794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:40:30.971794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:40:30.971794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d9e803d-586f-43e3-8606-762c986565ed could not be found. Aug 04 21:40:30.971794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:40:30.971794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:40:30.971794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:40:30.971794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:40:30.971794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:40:30.971794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:40:30.971794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:40:30.971794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:40:30.971794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:40:30.971794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:40:30.971794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:40:30.971794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:40:30.971794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 21:40:30.971794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:40:30.974441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d9e803d-586f-43e3-8606-762c986565ed could not be found. Aug 04 21:40:30.974441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:40:30.974441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:40:30.974441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:40:30.974441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:40:30.974441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:40:30.974441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:40:30.974441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:40:30.974441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:40:30.974441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d9e803d-586f-43e3-8606-762c986565ed could not be found. Aug 04 21:40:30.974441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:40:30.974441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d2fe9495-2f5d-4685-b383-8e162ec08592 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Returning 404 to user: Volume 0d9e803d-586f-43e3-8606-762c986565ed could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:40:30.974441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d2fe9495-2f5d-4685-b383-8e162ec08592 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/0d9e803d-586f-43e3-8606-762c986565ed" status: 404 len: 109 microversion: 2.1 time: 0.111627 Aug 04 21:40:30.984854 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 16/32] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 4 21:40:30 2022] GET /compute/v2.1/os-volumes/0d9e803d-586f-43e3-8606-762c986565ed => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:40:30.996036 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-fbe89ace-4e45-4069-8e7c-56114c2441a7 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Calling method '.version_select at 0x7f3c11c731f0>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:31.052400 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-fbe89ace-4e45-4069-8e7c-56114c2441a7 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] HTTP exception thrown: Volume 0d9e803d-586f-43e3-8606-762c986565ed could not be found. Aug 04 21:40:31.054949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-fbe89ace-4e45-4069-8e7c-56114c2441a7 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Request method failure captured: Aug 04 21:40:31.054949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: DELETE /compute/v2.1/os-volumes/0d9e803d-586f-43e3-8606-762c986565ed HTTP/1.1 Aug 04 21:40:31.054949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:40:31.054949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:40:31.054949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:40:31.054949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 21:40:31.054949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:40:31.054949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:40:31.054949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:40:31.054949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:40:31.054949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7Dy9t1Dzg1mpiOpCViUO766qsZiAFmXjMzGdHLEaEa18Pptz9TJxemAsfVOssc8suGrIDF8e5zUZWs_NgEB_sy8A3yPVKg2w5f9pQyutn1HQYw4MsVGzoP5-OHWTyZ_rovL2OjQc8zd8Qq2F2J4793F1cR8r3Ytrn489GXw9p1rJm7E Aug 04 21:40:31.054949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:40:31.054949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:40:31.054949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:40:31.054949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:40:31.054949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:40:31.054949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:40:31.054949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: df5356c0de064c2e83109c058870efb1 Aug 04 21:40:31.054949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1955884183 Aug 04 21:40:31.054949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:40:31.054949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:40:31.056113 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_df5356c0de064c2e83109c058870efb1", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/df5356c0de064c2e83109c058870efb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/df5356c0de064c2e83109c058870efb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/df5356c0de064c2e83109c058870efb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:40:31.056113 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1955884183 Aug 04 21:40:31.056113 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: df5356c0de064c2e83109c058870efb1 Aug 04 21:40:31.056113 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1955884183 Aug 04 21:40:31.056113 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-VolumesSnapshotsTestJSON-1955884183-project Aug 04 21:40:31.056113 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:40:31.056113 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:40:31.056113 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: cd348c0520e246d5814e035349bf7b90 Aug 04 21:40:31.056113 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1955884183-project Aug 04 21:40:31.056113 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: Aug 04 21:40:31.056113 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Volume 0d9e803d-586f-43e3-8606-762c986565ed could not be found. Aug 04 21:40:31.056113 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': '0d9e803d-586f-43e3-8606-762c986565ed'} Aug 04 21:40:31.056113 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:40:31.056833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:40:31.056833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:40:31.056833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:40:31.056833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 21:40:31.056833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 21:40:31.056833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 21:40:31.056833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 21:40:31.056833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 21:40:31.056833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 21:40:31.056833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 21:40:31.056833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 21:40:31.056833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:40:31.056833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:40:31.056833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:40:31.056833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:40:31.056833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d9e803d-586f-43e3-8606-762c986565ed could not be found. (HTTP 404) (Request-ID: req-990ae7a3-60ad-4ae6-aaee-8ebf1e436ac9) Aug 04 21:40:31.056833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:40:31.056833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:40:31.056833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:40:31.059700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:40:31.059700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 21:40:31.059700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 21:40:31.059700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:40:31.059700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:40:31.059700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 21:40:31.059700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 21:40:31.059700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:40:31.059700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:40:31.059700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:40:31.059700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:40:31.059700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 21:40:31.059700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 21:40:31.059700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 21:40:31.059700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 21:40:31.059700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 21:40:31.059700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 21:40:31.059700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 21:40:31.059700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 21:40:31.063426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:40:31.063426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:40:31.063426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:40:31.063426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:40:31.063426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d9e803d-586f-43e3-8606-762c986565ed could not be found. Aug 04 21:40:31.063426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:40:31.063426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:40:31.063426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:40:31.063426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:40:31.063426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:40:31.063426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:40:31.063426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:40:31.063426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:40:31.063426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:40:31.063426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:40:31.063426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:40:31.063426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:40:31.063426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 21:40:31.063426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:40:31.065811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d9e803d-586f-43e3-8606-762c986565ed could not be found. Aug 04 21:40:31.065811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:40:31.065811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:40:31.065811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:40:31.065811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:40:31.065811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:40:31.065811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:40:31.065811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:40:31.065811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:40:31.065811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d9e803d-586f-43e3-8606-762c986565ed could not be found. Aug 04 21:40:31.065811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:40:31.069073 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-fbe89ace-4e45-4069-8e7c-56114c2441a7 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Returning 404 to user: Volume 0d9e803d-586f-43e3-8606-762c986565ed could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:40:31.070326 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-fbe89ace-4e45-4069-8e7c-56114c2441a7 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/0d9e803d-586f-43e3-8606-762c986565ed" status: 404 len: 109 microversion: 2.1 time: 0.096373 Aug 04 21:40:31.071395 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 17/33] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 4 21:40:30 2022] DELETE /compute/v2.1/os-volumes/0d9e803d-586f-43e3-8606-762c986565ed => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:40:31.082504 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-cd4d73fb-5436-4cf6-9991-de0225e8c1f2 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Calling method '.version_select at 0x7f3c12ee70d0>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:31.137955 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-cd4d73fb-5436-4cf6-9991-de0225e8c1f2 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] HTTP exception thrown: Volume 0d9e803d-586f-43e3-8606-762c986565ed could not be found. Aug 04 21:40:31.141720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-cd4d73fb-5436-4cf6-9991-de0225e8c1f2 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Request method failure captured: Aug 04 21:40:31.141720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: GET /compute/v2.1/os-volumes/0d9e803d-586f-43e3-8606-762c986565ed HTTP/1.1 Aug 04 21:40:31.141720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:40:31.141720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:40:31.141720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:40:31.141720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:40:31.141720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:40:31.141720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:40:31.141720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:40:31.141720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:40:31.141720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7Dy9t1Dzg1mpiOpCViUO766qsZiAFmXjMzGdHLEaEa18Pptz9TJxemAsfVOssc8suGrIDF8e5zUZWs_NgEB_sy8A3yPVKg2w5f9pQyutn1HQYw4MsVGzoP5-OHWTyZ_rovL2OjQc8zd8Qq2F2J4793F1cR8r3Ytrn489GXw9p1rJm7E Aug 04 21:40:31.141720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:40:31.141720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:40:31.141720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:40:31.141720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:40:31.141720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:40:31.141720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:40:31.141720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: df5356c0de064c2e83109c058870efb1 Aug 04 21:40:31.141720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1955884183 Aug 04 21:40:31.141720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:40:31.141720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:40:31.143215 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_df5356c0de064c2e83109c058870efb1", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/df5356c0de064c2e83109c058870efb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/df5356c0de064c2e83109c058870efb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/df5356c0de064c2e83109c058870efb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:40:31.143215 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1955884183 Aug 04 21:40:31.143215 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: df5356c0de064c2e83109c058870efb1 Aug 04 21:40:31.143215 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1955884183 Aug 04 21:40:31.143215 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-VolumesSnapshotsTestJSON-1955884183-project Aug 04 21:40:31.143215 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:40:31.143215 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:40:31.143215 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: cd348c0520e246d5814e035349bf7b90 Aug 04 21:40:31.143215 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1955884183-project Aug 04 21:40:31.143215 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: Aug 04 21:40:31.143215 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Volume 0d9e803d-586f-43e3-8606-762c986565ed could not be found. Aug 04 21:40:31.143215 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': '0d9e803d-586f-43e3-8606-762c986565ed'} Aug 04 21:40:31.143215 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:40:31.143892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:40:31.143892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:40:31.143892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:40:31.143892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:40:31.143892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:40:31.143892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:40:31.143892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:40:31.143892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:40:31.143892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:40:31.143892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:40:31.143892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:40:31.143892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:40:31.143892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:40:31.143892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:40:31.143892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:40:31.143892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d9e803d-586f-43e3-8606-762c986565ed could not be found. (HTTP 404) (Request-ID: req-c50459d7-b65d-4e92-9374-c0c5d3b938ea) Aug 04 21:40:31.143892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:40:31.143892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:40:31.143892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:40:31.144811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:40:31.144811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 21:40:31.144811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 21:40:31.144811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:40:31.144811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:40:31.144811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 21:40:31.144811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 21:40:31.144811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:40:31.144811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:40:31.144811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:40:31.144811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:40:31.144811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:40:31.144811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:40:31.144811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:40:31.144811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:40:31.144811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:40:31.144811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:40:31.144811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:40:31.144811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:40:31.145782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:40:31.145782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:40:31.145782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:40:31.145782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:40:31.145782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d9e803d-586f-43e3-8606-762c986565ed could not be found. Aug 04 21:40:31.145782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:40:31.145782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:40:31.145782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:40:31.145782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:40:31.145782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:40:31.145782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:40:31.145782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:40:31.145782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:40:31.145782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:40:31.145782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:40:31.145782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:40:31.145782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:40:31.145782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 21:40:31.145782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:40:31.146907 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d9e803d-586f-43e3-8606-762c986565ed could not be found. Aug 04 21:40:31.146907 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:40:31.146907 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:40:31.146907 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:40:31.146907 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:40:31.146907 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:40:31.146907 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:40:31.146907 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:40:31.146907 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:40:31.146907 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d9e803d-586f-43e3-8606-762c986565ed could not be found. Aug 04 21:40:31.146907 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:40:31.146907 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-cd4d73fb-5436-4cf6-9991-de0225e8c1f2 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] Returning 404 to user: Volume 0d9e803d-586f-43e3-8606-762c986565ed could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:40:31.146907 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-cd4d73fb-5436-4cf6-9991-de0225e8c1f2 tempest-VolumesSnapshotsTestJSON-1955884183 tempest-VolumesSnapshotsTestJSON-1955884183-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/0d9e803d-586f-43e3-8606-762c986565ed" status: 404 len: 109 microversion: 2.1 time: 0.068055 Aug 04 21:40:31.159952 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 17/34] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 4 21:40:31 2022] GET /compute/v2.1/os-volumes/0d9e803d-586f-43e3-8606-762c986565ed => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:40:32.377210 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-0b4f7ad2-ebec-490a-a2b7-bf5d70c1d1cc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Action: 'create', calling method: .version_select at 0x7f3c11c6d670>, body: {"keypair": {"name": "tempest-keypair-1583645689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEbiRiBrJx1nnc5ODyZif3RUkrLZBekl8OVYuAfEER9s1ScuYbtGjBHALlPR6vJ6lRUD4vvf2BoweCHQuNj0hwy0I3X0iin0MwcP++a8pKdZGBwpqWa4rNmZvWotXAb6w=="}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:40:32.437148 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-0b4f7ad2-ebec-490a-a2b7-bf5d70c1d1cc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Getting quotas for project 4b95ce24a4d34e379fa86c9114ece400. Resources: {'key_pairs'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:40:32.445491 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-0b4f7ad2-ebec-490a-a2b7-bf5d70c1d1cc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Getting quotas for user 95fb2edf82644e7f8ce461fcbb52007b and project 4b95ce24a4d34e379fa86c9114ece400. Resources: {'key_pairs'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:40:32.615621 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-0b4f7ad2-ebec-490a-a2b7-bf5d70c1d1cc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.342305 Aug 04 21:40:32.616917 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 18/35] 10.222.0.73 () {62 vars in 1200 bytes} [Thu Aug 4 21:40:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1344 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 21:40:32.632497 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-7e2af280-5da0-4ec3-a46a-3729c51e06c7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1842758345", "imageRef": "fca0c9ba-fb0a-4f30-932f-84d5253674ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:40:32.850022 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-706c43d6-7c1f-4d8f-a7ec-f982dfac4b1e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2134772053", "imageRef": "fca0c9ba-fb0a-4f30-932f-84d5253674ad", "flavorRef": "452", "networks": [{"uuid": "d9e2cfe9-0d1d-49c0-954d-1d72f93312ee"}]}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:40:32.969599 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.network.neutron [None req-7e2af280-5da0-4ec3-a46a-3729c51e06c7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] validate_networks() for [('2b5f55cd-34ce-4149-9b84-6f8297ec2159', None, None, None, None, None)] {{(pid=136342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:40:33.123384 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.network.neutron [None req-706c43d6-7c1f-4d8f-a7ec-f982dfac4b1e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] validate_networks() for [('d9e2cfe9-0d1d-49c0-954d-1d72f93312ee', None, None, None, None, None)] {{(pid=136341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:40:34.784890 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-7e2af280-5da0-4ec3-a46a-3729c51e06c7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Flavor limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:40:34.785465 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-7e2af280-5da0-4ec3-a46a-3729c51e06c7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Image limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:40:34.786183 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-7e2af280-5da0-4ec3-a46a-3729c51e06c7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Flavor pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:40:34.790207 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-7e2af280-5da0-4ec3-a46a-3729c51e06c7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Image pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:40:34.790207 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-7e2af280-5da0-4ec3-a46a-3729c51e06c7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:40:34.802987 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7e2af280-5da0-4ec3-a46a-3729c51e06c7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:34.803463 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7e2af280-5da0-4ec3-a46a-3729c51e06c7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:34.804148 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7e2af280-5da0-4ec3-a46a-3729c51e06c7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:34.804943 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7e2af280-5da0-4ec3-a46a-3729c51e06c7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:34.805597 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7e2af280-5da0-4ec3-a46a-3729c51e06c7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:34.806112 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7e2af280-5da0-4ec3-a46a-3729c51e06c7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:34.895784 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-7e2af280-5da0-4ec3-a46a-3729c51e06c7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Getting quotas for project 26fb895147494be98bb6ceb8704984b7. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:40:34.909935 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-7e2af280-5da0-4ec3-a46a-3729c51e06c7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Getting quotas for user d9bc42bec393430b9b3e9399a8c4f95e and project 26fb895147494be98bb6ceb8704984b7. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:40:34.931295 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-706c43d6-7c1f-4d8f-a7ec-f982dfac4b1e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Flavor limits 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:40:34.932974 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-706c43d6-7c1f-4d8f-a7ec-f982dfac4b1e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Image limits 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:40:34.933467 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-706c43d6-7c1f-4d8f-a7ec-f982dfac4b1e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Flavor pref 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:40:34.933872 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-706c43d6-7c1f-4d8f-a7ec-f982dfac4b1e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Image pref 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:40:34.934368 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-706c43d6-7c1f-4d8f-a7ec-f982dfac4b1e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:40:34.939603 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7e2af280-5da0-4ec3-a46a-3729c51e06c7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Going to run 1 instances... {{(pid=136342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:40:34.939603 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7e2af280-5da0-4ec3-a46a-3729c51e06c7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca0c9ba-fb0a-4f30-932f-84d5253674ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:40:34.945465 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-706c43d6-7c1f-4d8f-a7ec-f982dfac4b1e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:34.946393 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-706c43d6-7c1f-4d8f-a7ec-f982dfac4b1e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:34.946755 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-706c43d6-7c1f-4d8f-a7ec-f982dfac4b1e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:34.947750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-706c43d6-7c1f-4d8f-a7ec-f982dfac4b1e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:34.948399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-706c43d6-7c1f-4d8f-a7ec-f982dfac4b1e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:34.949115 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-706c43d6-7c1f-4d8f-a7ec-f982dfac4b1e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:34.976924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-706c43d6-7c1f-4d8f-a7ec-f982dfac4b1e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Getting quotas for project 4c113838ba92441c89e4447d7d567b31. Resources: {'instances', 'cores', 'ram'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:40:34.983793 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-706c43d6-7c1f-4d8f-a7ec-f982dfac4b1e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Getting quotas for user d681a6cc3e5247c9bb2537a6cacb7dd4 and project 4c113838ba92441c89e4447d7d567b31. Resources: {'instances', 'cores', 'ram'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:40:35.004784 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-706c43d6-7c1f-4d8f-a7ec-f982dfac4b1e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Going to run 1 instances... {{(pid=136341) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:40:35.008089 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-706c43d6-7c1f-4d8f-a7ec-f982dfac4b1e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca0c9ba-fb0a-4f30-932f-84d5253674ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:40:35.165852 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-7e2af280-5da0-4ec3-a46a-3729c51e06c7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.046199 Aug 04 21:40:35.175202 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 18/36] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 4 21:40:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 3056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:40:35.183656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e9e805ee-5591-4528-806e-ddcbab0a39e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-884998350", "imageRef": "fca0c9ba-fb0a-4f30-932f-84d5253674ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4b36145-27e4-4095-881b-72edbb672f32"}], "security_groups": [{"name": "tempest-securitygroup--2078975071"}], "key_name": "tempest-keypair-429370592", "user_data": "}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:40:35.256265 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-706c43d6-7c1f-4d8f-a7ec-f982dfac4b1e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.638119 Aug 04 21:40:35.256920 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 19/37] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 4 21:40:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:40:35.310752 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ef6d7c28-a5df-4218-8aa8-08f13d5ea5ca tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:35.312389 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ef6d7c28-a5df-4218-8aa8-08f13d5ea5ca tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:35.466485 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.network.neutron [None req-e9e805ee-5591-4528-806e-ddcbab0a39e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] validate_networks() for [('d4b36145-27e4-4095-881b-72edbb672f32', None, None, None, None, None)] {{(pid=136342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:40:35.668512 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ef6d7c28-a5df-4218-8aa8-08f13d5ea5ca tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:35.700515 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ef6d7c28-a5df-4218-8aa8-08f13d5ea5ca tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1222 microversion: 2.1 time: 0.436204 Aug 04 21:40:35.702293 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 20/38] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:35 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1222 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:35.737877 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-978083da-13a0-4a4c-8ddb-b95529eec073 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:35.739724 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-978083da-13a0-4a4c-8ddb-b95529eec073 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:35.953149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-978083da-13a0-4a4c-8ddb-b95529eec073 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:35.962714 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-978083da-13a0-4a4c-8ddb-b95529eec073 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1215 microversion: 2.1 time: 0.242472 Aug 04 21:40:35.963297 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 21/39] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:35 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1215 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:36.274382 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2224c0a5-f1c3-4e69-a4cd-b07db80829a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1203953717", "imageRef": "fca0c9ba-fb0a-4f30-932f-84d5253674ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:40:36.447310 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-e9e805ee-5591-4528-806e-ddcbab0a39e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Flavor limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:40:36.449231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-e9e805ee-5591-4528-806e-ddcbab0a39e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Image limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:40:36.449851 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-e9e805ee-5591-4528-806e-ddcbab0a39e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Flavor pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:40:36.450422 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-e9e805ee-5591-4528-806e-ddcbab0a39e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Image pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:40:36.450987 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-e9e805ee-5591-4528-806e-ddcbab0a39e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:40:36.470284 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e9e805ee-5591-4528-806e-ddcbab0a39e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:36.470715 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e9e805ee-5591-4528-806e-ddcbab0a39e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:36.471052 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.network.neutron [None req-2224c0a5-f1c3-4e69-a4cd-b07db80829a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] validate_networks() for [('2b5f55cd-34ce-4149-9b84-6f8297ec2159', None, None, None, None, None)] {{(pid=136341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:40:36.471171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e9e805ee-5591-4528-806e-ddcbab0a39e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:36.472201 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e9e805ee-5591-4528-806e-ddcbab0a39e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:36.474879 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e9e805ee-5591-4528-806e-ddcbab0a39e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:36.475358 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e9e805ee-5591-4528-806e-ddcbab0a39e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:36.517048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-e9e805ee-5591-4528-806e-ddcbab0a39e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Getting quotas for project 09370df0a2354bd2a412c6770d3ff165. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:40:36.532274 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-e9e805ee-5591-4528-806e-ddcbab0a39e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Getting quotas for user a23fcabad2354e7ab51a22b412bf11e6 and project 09370df0a2354bd2a412c6770d3ff165. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:40:36.566913 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e9e805ee-5591-4528-806e-ddcbab0a39e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Going to run 1 instances... {{(pid=136342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:40:36.570454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e9e805ee-5591-4528-806e-ddcbab0a39e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca0c9ba-fb0a-4f30-932f-84d5253674ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:40:36.819795 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e9e805ee-5591-4528-806e-ddcbab0a39e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.643066 Aug 04 21:40:36.825970 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 19/40] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 4 21:40:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 1650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:40:36.841623 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2d8d8357-656b-44a6-a9a7-7391264e3f31 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:36.851680 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2d8d8357-656b-44a6-a9a7-7391264e3f31 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:37.105700 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2d8d8357-656b-44a6-a9a7-7391264e3f31 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:37.132409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2d8d8357-656b-44a6-a9a7-7391264e3f31 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1236 microversion: 2.1 time: 0.301262 Aug 04 21:40:37.132982 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 20/41] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:36 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1236 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:37.147404 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a75d7d9a-6901-446e-a91a-cb7931033a14 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:37.148213 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-a75d7d9a-6901-446e-a91a-cb7931033a14 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:37.273165 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-a75d7d9a-6901-446e-a91a-cb7931033a14 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:37.287503 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-a75d7d9a-6901-446e-a91a-cb7931033a14 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1215 microversion: 2.1 time: 0.153448 Aug 04 21:40:37.288763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 21/42] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:37 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1215 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:37.985285 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-2224c0a5-f1c3-4e69-a4cd-b07db80829a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Flavor limits 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:40:37.985796 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-2224c0a5-f1c3-4e69-a4cd-b07db80829a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Image limits 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:40:37.986376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-2224c0a5-f1c3-4e69-a4cd-b07db80829a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Flavor pref 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:40:37.986827 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-2224c0a5-f1c3-4e69-a4cd-b07db80829a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Image pref 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:40:37.987271 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-2224c0a5-f1c3-4e69-a4cd-b07db80829a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:40:38.003711 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2224c0a5-f1c3-4e69-a4cd-b07db80829a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:38.004442 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2224c0a5-f1c3-4e69-a4cd-b07db80829a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:38.005051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2224c0a5-f1c3-4e69-a4cd-b07db80829a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:38.005944 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2224c0a5-f1c3-4e69-a4cd-b07db80829a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:38.006570 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2224c0a5-f1c3-4e69-a4cd-b07db80829a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:38.007217 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2224c0a5-f1c3-4e69-a4cd-b07db80829a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:38.037957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-2224c0a5-f1c3-4e69-a4cd-b07db80829a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Getting quotas for project 26fb895147494be98bb6ceb8704984b7. Resources: {'instances', 'cores', 'ram'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:40:38.051984 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-2224c0a5-f1c3-4e69-a4cd-b07db80829a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Getting quotas for user d9bc42bec393430b9b3e9399a8c4f95e and project 26fb895147494be98bb6ceb8704984b7. Resources: {'instances', 'cores', 'ram'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:40:38.076658 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-2224c0a5-f1c3-4e69-a4cd-b07db80829a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Going to run 1 instances... {{(pid=136341) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:40:38.079369 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-2224c0a5-f1c3-4e69-a4cd-b07db80829a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca0c9ba-fb0a-4f30-932f-84d5253674ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:40:38.154752 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-35cf9b1c-81d1-4733-8817-cf5110edd920 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:38.156456 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-35cf9b1c-81d1-4733-8817-cf5110edd920 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:38.286299 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-35cf9b1c-81d1-4733-8817-cf5110edd920 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:38.294251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-35cf9b1c-81d1-4733-8817-cf5110edd920 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1236 microversion: 2.1 time: 0.145319 Aug 04 21:40:38.296554 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 22/43] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:38 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1236 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:38.311801 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-9520d566-2885-4f4f-9085-79f79d8420b9 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:38.313114 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2224c0a5-f1c3-4e69-a4cd-b07db80829a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.044818 Aug 04 21:40:38.313218 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-9520d566-2885-4f4f-9085-79f79d8420b9 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:38.313310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 22/44] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 4 21:40:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 2046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:40:38.326609 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b13fc847-8beb-4833-a62a-5cc6029e9ca1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:38.327423 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b13fc847-8beb-4833-a62a-5cc6029e9ca1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:38.392427 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-9520d566-2885-4f4f-9085-79f79d8420b9 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:38.404386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-9520d566-2885-4f4f-9085-79f79d8420b9 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1215 microversion: 2.1 time: 0.096386 Aug 04 21:40:38.413879 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 23/45] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:38 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1215 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:40:38.425991 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b13fc847-8beb-4833-a62a-5cc6029e9ca1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:38.440613 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b13fc847-8beb-4833-a62a-5cc6029e9ca1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1222 microversion: 2.1 time: 0.117197 Aug 04 21:40:38.443450 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 23/46] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:38 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1222 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:39.220607 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ddf1f121-7acd-4c3e-9963-df7889596615 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-33657036", "imageRef": "fca0c9ba-fb0a-4f30-932f-84d5253674ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4aeba8f5-6b21-4436-abd6-8d1c71bccde2"}], "security_groups": [{"name": "tempest-securitygroup--1289761116"}], "key_name": "tempest-keypair-1583645689", "user_data": "}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:40:39.324305 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-1f3646a2-d81b-4a83-8254-eb90f92640e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:39.325570 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-1f3646a2-d81b-4a83-8254-eb90f92640e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:39.350930 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1f3646a2-d81b-4a83-8254-eb90f92640e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:39.351588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1f3646a2-d81b-4a83-8254-eb90f92640e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:39.352156 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1f3646a2-d81b-4a83-8254-eb90f92640e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:39.352896 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1f3646a2-d81b-4a83-8254-eb90f92640e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:39.353351 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1f3646a2-d81b-4a83-8254-eb90f92640e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:39.354904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1f3646a2-d81b-4a83-8254-eb90f92640e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:39.458252 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.network.neutron [None req-ddf1f121-7acd-4c3e-9963-df7889596615 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] validate_networks() for [('4aeba8f5-6b21-4436-abd6-8d1c71bccde2', None, None, None, None, None)] {{(pid=136342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:40:39.737463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-1f3646a2-d81b-4a83-8254-eb90f92640e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:39.757975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-1f3646a2-d81b-4a83-8254-eb90f92640e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1240 microversion: 2.1 time: 0.437562 Aug 04 21:40:39.768366 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 24/47] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:39 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1240 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:40:39.768366 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-79012de3-1608-4fe7-ba5e-e7d6e0e5a87c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:39.768366 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-79012de3-1608-4fe7-ba5e-e7d6e0e5a87c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:39.773542 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-79012de3-1608-4fe7-ba5e-e7d6e0e5a87c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:39.774070 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-79012de3-1608-4fe7-ba5e-e7d6e0e5a87c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:39.778587 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-79012de3-1608-4fe7-ba5e-e7d6e0e5a87c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:39.779441 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-79012de3-1608-4fe7-ba5e-e7d6e0e5a87c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:39.780011 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-79012de3-1608-4fe7-ba5e-e7d6e0e5a87c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:39.784696 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-79012de3-1608-4fe7-ba5e-e7d6e0e5a87c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:40.114260 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-79012de3-1608-4fe7-ba5e-e7d6e0e5a87c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:40.125834 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-79012de3-1608-4fe7-ba5e-e7d6e0e5a87c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1211 microversion: 2.1 time: 0.365642 Aug 04 21:40:40.127884 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 25/48] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:39 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1211 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:40.133604 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-ddf1f121-7acd-4c3e-9963-df7889596615 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Flavor limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:40:40.139314 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-ddf1f121-7acd-4c3e-9963-df7889596615 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Image limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:40:40.140647 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-ddf1f121-7acd-4c3e-9963-df7889596615 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Flavor pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:40:40.142624 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-ddf1f121-7acd-4c3e-9963-df7889596615 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Image pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:40:40.143493 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-ddf1f121-7acd-4c3e-9963-df7889596615 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:40:40.172512 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-7c6dc822-6d4b-45d1-9e20-d0dd3e23a569 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:40.175179 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-7c6dc822-6d4b-45d1-9e20-d0dd3e23a569 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:40.179480 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ddf1f121-7acd-4c3e-9963-df7889596615 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:40.181190 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ddf1f121-7acd-4c3e-9963-df7889596615 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:40.183395 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ddf1f121-7acd-4c3e-9963-df7889596615 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:40.186412 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ddf1f121-7acd-4c3e-9963-df7889596615 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:40.186881 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ddf1f121-7acd-4c3e-9963-df7889596615 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:40.187310 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ddf1f121-7acd-4c3e-9963-df7889596615 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:40.197939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7c6dc822-6d4b-45d1-9e20-d0dd3e23a569 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:40.200968 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7c6dc822-6d4b-45d1-9e20-d0dd3e23a569 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:40.201420 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7c6dc822-6d4b-45d1-9e20-d0dd3e23a569 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:40.209385 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7c6dc822-6d4b-45d1-9e20-d0dd3e23a569 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:40.209385 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7c6dc822-6d4b-45d1-9e20-d0dd3e23a569 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:40.209616 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7c6dc822-6d4b-45d1-9e20-d0dd3e23a569 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:40.253460 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-ddf1f121-7acd-4c3e-9963-df7889596615 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Getting quotas for project 4b95ce24a4d34e379fa86c9114ece400. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:40:40.269518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-ddf1f121-7acd-4c3e-9963-df7889596615 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Getting quotas for user 95fb2edf82644e7f8ce461fcbb52007b and project 4b95ce24a4d34e379fa86c9114ece400. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:40:40.315363 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ddf1f121-7acd-4c3e-9963-df7889596615 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Going to run 1 instances... {{(pid=136342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:40:40.318960 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ddf1f121-7acd-4c3e-9963-df7889596615 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca0c9ba-fb0a-4f30-932f-84d5253674ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:40:40.657251 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-7c6dc822-6d4b-45d1-9e20-d0dd3e23a569 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:40.657251 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-7c6dc822-6d4b-45d1-9e20-d0dd3e23a569 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1226 microversion: 2.1 time: 0.328493 Aug 04 21:40:40.657251 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 26/49] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:40 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1226 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:40.780205 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b3773ab4-ec28-445a-ac46-1cd6f70a8659 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:40.780813 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b3773ab4-ec28-445a-ac46-1cd6f70a8659 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:40.786848 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b3773ab4-ec28-445a-ac46-1cd6f70a8659 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:40.787306 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b3773ab4-ec28-445a-ac46-1cd6f70a8659 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:40.787739 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b3773ab4-ec28-445a-ac46-1cd6f70a8659 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:40.788415 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b3773ab4-ec28-445a-ac46-1cd6f70a8659 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:40.788863 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b3773ab4-ec28-445a-ac46-1cd6f70a8659 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:40.789283 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b3773ab4-ec28-445a-ac46-1cd6f70a8659 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:40.851549 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b3773ab4-ec28-445a-ac46-1cd6f70a8659 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:40.859529 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b3773ab4-ec28-445a-ac46-1cd6f70a8659 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1232 microversion: 2.1 time: 0.084341 Aug 04 21:40:40.860087 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 27/50] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:40 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1232 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:40:40.909076 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ddf1f121-7acd-4c3e-9963-df7889596615 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.692799 Aug 04 21:40:40.913074 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 24/51] 10.222.0.73 () {62 vars in 1188 bytes} [Thu Aug 4 21:40:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1699 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 21:40:40.926829 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-19c006ba-c03f-4063-8f66-3e61d9e05a37 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:40.927511 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-19c006ba-c03f-4063-8f66-3e61d9e05a37 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:41.017865 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-19c006ba-c03f-4063-8f66-3e61d9e05a37 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:41.028097 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-19c006ba-c03f-4063-8f66-3e61d9e05a37 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:41.030205 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-19c006ba-c03f-4063-8f66-3e61d9e05a37 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:41.032172 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-19c006ba-c03f-4063-8f66-3e61d9e05a37 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1280 microversion: 2.20 time: 0.111144 Aug 04 21:40:41.047018 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 28/52] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:40:40 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1280 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:40:41.147921 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-fc56d259-7af8-47a1-8546-8cb6bff452a7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:41.149717 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-fc56d259-7af8-47a1-8546-8cb6bff452a7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:41.160167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fc56d259-7af8-47a1-8546-8cb6bff452a7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:41.161000 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fc56d259-7af8-47a1-8546-8cb6bff452a7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:41.161674 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fc56d259-7af8-47a1-8546-8cb6bff452a7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:41.162990 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fc56d259-7af8-47a1-8546-8cb6bff452a7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:41.163687 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fc56d259-7af8-47a1-8546-8cb6bff452a7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:41.164628 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fc56d259-7af8-47a1-8546-8cb6bff452a7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:41.333865 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-fc56d259-7af8-47a1-8546-8cb6bff452a7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:41.355316 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-fc56d259-7af8-47a1-8546-8cb6bff452a7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1275 microversion: 2.1 time: 0.211351 Aug 04 21:40:41.355939 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 25/53] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:41 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1275 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:41.483010 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-7529682c-9507-496c-9dc9-4d0b07747131 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:41.483750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-7529682c-9507-496c-9dc9-4d0b07747131 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:41.490119 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7529682c-9507-496c-9dc9-4d0b07747131 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:41.492723 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7529682c-9507-496c-9dc9-4d0b07747131 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:41.493174 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7529682c-9507-496c-9dc9-4d0b07747131 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:41.493880 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7529682c-9507-496c-9dc9-4d0b07747131 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:41.494363 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7529682c-9507-496c-9dc9-4d0b07747131 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:41.495434 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7529682c-9507-496c-9dc9-4d0b07747131 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:41.697742 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-7529682c-9507-496c-9dc9-4d0b07747131 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:41.707748 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-7529682c-9507-496c-9dc9-4d0b07747131 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1274 microversion: 2.1 time: 0.229222 Aug 04 21:40:41.727143 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 29/54] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:41 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1274 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:41.882309 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-10d9b9e8-c0e7-4dd9-bcab-2dac732a84fe tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:41.883658 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-10d9b9e8-c0e7-4dd9-bcab-2dac732a84fe tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:41.890186 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-10d9b9e8-c0e7-4dd9-bcab-2dac732a84fe tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:41.890777 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-10d9b9e8-c0e7-4dd9-bcab-2dac732a84fe tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:41.891287 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-10d9b9e8-c0e7-4dd9-bcab-2dac732a84fe tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:41.892092 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-10d9b9e8-c0e7-4dd9-bcab-2dac732a84fe tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:41.892622 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-10d9b9e8-c0e7-4dd9-bcab-2dac732a84fe tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:41.893120 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-10d9b9e8-c0e7-4dd9-bcab-2dac732a84fe tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:42.057433 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ce1e072d-028c-41ce-9ac6-99d114aa267b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:42.058195 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ce1e072d-028c-41ce-9ac6-99d114aa267b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:42.265624 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ce1e072d-028c-41ce-9ac6-99d114aa267b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:42.277442 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-10d9b9e8-c0e7-4dd9-bcab-2dac732a84fe tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:42.282887 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ce1e072d-028c-41ce-9ac6-99d114aa267b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:42.284544 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ce1e072d-028c-41ce-9ac6-99d114aa267b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:42.285403 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-10d9b9e8-c0e7-4dd9-bcab-2dac732a84fe tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1288 microversion: 2.1 time: 0.407371 Aug 04 21:40:42.285856 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ce1e072d-028c-41ce-9ac6-99d114aa267b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1280 microversion: 2.20 time: 0.232757 Aug 04 21:40:42.285971 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 26/55] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:41 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1288 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:42.328764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 30/56] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:40:42 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1280 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:40:42.378975 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-907e6629-8c98-4a83-98e9-393beaa2e62d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:42.380208 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-907e6629-8c98-4a83-98e9-393beaa2e62d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:42.389652 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-907e6629-8c98-4a83-98e9-393beaa2e62d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:42.391721 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-907e6629-8c98-4a83-98e9-393beaa2e62d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:42.394097 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-907e6629-8c98-4a83-98e9-393beaa2e62d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:42.394097 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-907e6629-8c98-4a83-98e9-393beaa2e62d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:42.394097 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-907e6629-8c98-4a83-98e9-393beaa2e62d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:42.399188 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-907e6629-8c98-4a83-98e9-393beaa2e62d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:42.552881 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-907e6629-8c98-4a83-98e9-393beaa2e62d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:42.562122 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-907e6629-8c98-4a83-98e9-393beaa2e62d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1273 microversion: 2.1 time: 0.187958 Aug 04 21:40:42.571128 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 27/57] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:42 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1273 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:42.730925 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-17088274-8760-46ab-a9ca-d8270edaf679 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:42.731916 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-17088274-8760-46ab-a9ca-d8270edaf679 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:42.746831 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-17088274-8760-46ab-a9ca-d8270edaf679 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:42.749201 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-17088274-8760-46ab-a9ca-d8270edaf679 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:42.751320 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-17088274-8760-46ab-a9ca-d8270edaf679 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:42.752418 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-17088274-8760-46ab-a9ca-d8270edaf679 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:42.754135 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-17088274-8760-46ab-a9ca-d8270edaf679 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:42.755886 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-17088274-8760-46ab-a9ca-d8270edaf679 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:42.960623 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-17088274-8760-46ab-a9ca-d8270edaf679 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:42.973551 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-17088274-8760-46ab-a9ca-d8270edaf679 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1282 microversion: 2.1 time: 0.247812 Aug 04 21:40:42.975841 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 31/58] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:42 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1282 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:43.313760 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4fba075c-ed4f-41be-b382-d76dbd195a5b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:43.314634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4fba075c-ed4f-41be-b382-d76dbd195a5b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:43.322475 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4fba075c-ed4f-41be-b382-d76dbd195a5b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:43.323379 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4fba075c-ed4f-41be-b382-d76dbd195a5b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:43.324861 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4fba075c-ed4f-41be-b382-d76dbd195a5b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:43.327333 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4fba075c-ed4f-41be-b382-d76dbd195a5b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:43.328305 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4fba075c-ed4f-41be-b382-d76dbd195a5b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:43.329323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4fba075c-ed4f-41be-b382-d76dbd195a5b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:43.342044 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-fdc928cb-67b3-4d0e-9c62-46543fb2d974 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:43.342915 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-fdc928cb-67b3-4d0e-9c62-46543fb2d974 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:43.356509 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fdc928cb-67b3-4d0e-9c62-46543fb2d974 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:43.359630 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fdc928cb-67b3-4d0e-9c62-46543fb2d974 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:43.365281 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fdc928cb-67b3-4d0e-9c62-46543fb2d974 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:43.366605 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fdc928cb-67b3-4d0e-9c62-46543fb2d974 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:43.368219 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fdc928cb-67b3-4d0e-9c62-46543fb2d974 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:43.370507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fdc928cb-67b3-4d0e-9c62-46543fb2d974 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:43.532977 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-fdc928cb-67b3-4d0e-9c62-46543fb2d974 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:43.550892 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-fdc928cb-67b3-4d0e-9c62-46543fb2d974 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:43.552572 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-fdc928cb-67b3-4d0e-9c62-46543fb2d974 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:43.562338 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-fdc928cb-67b3-4d0e-9c62-46543fb2d974 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1284 microversion: 2.20 time: 0.217744 Aug 04 21:40:43.563333 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 32/59] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:40:43 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1284 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:40:43.585798 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-1a3a19aa-25e9-44dc-9500-9f9e29764b3c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:43.586478 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-1a3a19aa-25e9-44dc-9500-9f9e29764b3c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:43.590570 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4fba075c-ed4f-41be-b382-d76dbd195a5b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:43.607628 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1a3a19aa-25e9-44dc-9500-9f9e29764b3c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:43.608130 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1a3a19aa-25e9-44dc-9500-9f9e29764b3c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:43.608562 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1a3a19aa-25e9-44dc-9500-9f9e29764b3c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:43.609264 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1a3a19aa-25e9-44dc-9500-9f9e29764b3c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:43.612836 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1a3a19aa-25e9-44dc-9500-9f9e29764b3c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:43.613485 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1a3a19aa-25e9-44dc-9500-9f9e29764b3c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:43.634290 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4fba075c-ed4f-41be-b382-d76dbd195a5b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1294 microversion: 2.1 time: 0.323985 Aug 04 21:40:43.644559 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 28/60] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:43 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1294 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:43.965502 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-1a3a19aa-25e9-44dc-9500-9f9e29764b3c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:43.976841 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-1a3a19aa-25e9-44dc-9500-9f9e29764b3c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.395278 Aug 04 21:40:43.980049 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 33/61] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:43 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:44.004071 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-dd40a48b-a3fa-4f1f-abb7-e6f80fcee5b4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:44.005346 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-dd40a48b-a3fa-4f1f-abb7-e6f80fcee5b4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:44.029837 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dd40a48b-a3fa-4f1f-abb7-e6f80fcee5b4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:44.033695 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dd40a48b-a3fa-4f1f-abb7-e6f80fcee5b4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:44.039040 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dd40a48b-a3fa-4f1f-abb7-e6f80fcee5b4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:44.040753 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dd40a48b-a3fa-4f1f-abb7-e6f80fcee5b4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:44.043140 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dd40a48b-a3fa-4f1f-abb7-e6f80fcee5b4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:44.043601 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dd40a48b-a3fa-4f1f-abb7-e6f80fcee5b4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:44.589745 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-745a4486-6f87-48e8-91cd-de55d4778b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:44.591109 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-745a4486-6f87-48e8-91cd-de55d4778b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:44.610463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-745a4486-6f87-48e8-91cd-de55d4778b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:44.613719 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-745a4486-6f87-48e8-91cd-de55d4778b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:44.613719 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-745a4486-6f87-48e8-91cd-de55d4778b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:44.624305 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-745a4486-6f87-48e8-91cd-de55d4778b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:44.624843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-745a4486-6f87-48e8-91cd-de55d4778b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:44.633550 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-745a4486-6f87-48e8-91cd-de55d4778b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:44.776766 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-dd40a48b-a3fa-4f1f-abb7-e6f80fcee5b4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:44.788189 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-dd40a48b-a3fa-4f1f-abb7-e6f80fcee5b4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1280 microversion: 2.1 time: 0.790153 Aug 04 21:40:44.789299 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 29/62] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:43 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1280 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:44.809893 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-dc89e8a2-aff8-4f2c-9502-07a9e4b95928 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:44.812937 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-dc89e8a2-aff8-4f2c-9502-07a9e4b95928 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:44.852734 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dc89e8a2-aff8-4f2c-9502-07a9e4b95928 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:44.862288 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dc89e8a2-aff8-4f2c-9502-07a9e4b95928 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:44.864807 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dc89e8a2-aff8-4f2c-9502-07a9e4b95928 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:44.867553 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dc89e8a2-aff8-4f2c-9502-07a9e4b95928 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:44.868104 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dc89e8a2-aff8-4f2c-9502-07a9e4b95928 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:44.868551 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dc89e8a2-aff8-4f2c-9502-07a9e4b95928 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:45.039551 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-745a4486-6f87-48e8-91cd-de55d4778b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:45.039551 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-745a4486-6f87-48e8-91cd-de55d4778b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:45.053072 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-745a4486-6f87-48e8-91cd-de55d4778b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:45.054522 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-745a4486-6f87-48e8-91cd-de55d4778b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1332 microversion: 2.20 time: 0.469958 Aug 04 21:40:45.074652 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 34/63] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:40:44 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1332 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:40:45.090525 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c9c28aa3-2e15-499f-a4fc-0c9777360384 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:45.091141 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c9c28aa3-2e15-499f-a4fc-0c9777360384 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:45.103597 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9c28aa3-2e15-499f-a4fc-0c9777360384 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:45.109955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9c28aa3-2e15-499f-a4fc-0c9777360384 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:45.110741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9c28aa3-2e15-499f-a4fc-0c9777360384 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:45.111911 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9c28aa3-2e15-499f-a4fc-0c9777360384 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:45.112533 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9c28aa3-2e15-499f-a4fc-0c9777360384 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:45.113182 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9c28aa3-2e15-499f-a4fc-0c9777360384 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:45.294280 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-dc89e8a2-aff8-4f2c-9502-07a9e4b95928 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:45.306128 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-dc89e8a2-aff8-4f2c-9502-07a9e4b95928 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1294 microversion: 2.1 time: 0.512200 Aug 04 21:40:45.311105 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 30/64] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:44 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1294 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:45.824154 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8aa9734c-7a80-46bd-b4ef-df8da00c6fd0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:45.828664 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8aa9734c-7a80-46bd-b4ef-df8da00c6fd0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:45.853873 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8aa9734c-7a80-46bd-b4ef-df8da00c6fd0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:45.853873 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8aa9734c-7a80-46bd-b4ef-df8da00c6fd0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:45.853873 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8aa9734c-7a80-46bd-b4ef-df8da00c6fd0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:45.853873 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8aa9734c-7a80-46bd-b4ef-df8da00c6fd0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:45.856116 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8aa9734c-7a80-46bd-b4ef-df8da00c6fd0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:45.856116 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8aa9734c-7a80-46bd-b4ef-df8da00c6fd0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:46.262111 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-c9c28aa3-2e15-499f-a4fc-0c9777360384 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:46.280739 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c9c28aa3-2e15-499f-a4fc-0c9777360384 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 1.205346 Aug 04 21:40:46.282730 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 35/65] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:45 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:46.290638 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-6140ea17-b8f5-492a-bd77-15b71e485d5d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:46.294167 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-6140ea17-b8f5-492a-bd77-15b71e485d5d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:46.335851 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6140ea17-b8f5-492a-bd77-15b71e485d5d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:46.341701 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6140ea17-b8f5-492a-bd77-15b71e485d5d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:46.341701 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6140ea17-b8f5-492a-bd77-15b71e485d5d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:46.341701 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6140ea17-b8f5-492a-bd77-15b71e485d5d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:46.341701 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6140ea17-b8f5-492a-bd77-15b71e485d5d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:46.346856 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6140ea17-b8f5-492a-bd77-15b71e485d5d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:46.471220 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6140ea17-b8f5-492a-bd77-15b71e485d5d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:46.483209 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6140ea17-b8f5-492a-bd77-15b71e485d5d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:46.492496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6140ea17-b8f5-492a-bd77-15b71e485d5d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:46.493759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-6140ea17-b8f5-492a-bd77-15b71e485d5d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1338 microversion: 2.20 time: 0.208985 Aug 04 21:40:46.495623 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 36/66] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:40:46 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1338 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:40:46.503290 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-17115434-6448-4672-bbda-4ca736e579ab tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:46.504099 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-17115434-6448-4672-bbda-4ca736e579ab tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:46.516452 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:40:46.517447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-17115434-6448-4672-bbda-4ca736e579ab tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:46.518410 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-17115434-6448-4672-bbda-4ca736e579ab tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:46.519081 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-17115434-6448-4672-bbda-4ca736e579ab tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:46.528167 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-17115434-6448-4672-bbda-4ca736e579ab tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:46.530422 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-17115434-6448-4672-bbda-4ca736e579ab tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:46.531251 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-17115434-6448-4672-bbda-4ca736e579ab tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:46.919896 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8aa9734c-7a80-46bd-b4ef-df8da00c6fd0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:46.928974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8aa9734c-7a80-46bd-b4ef-df8da00c6fd0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 1.116760 Aug 04 21:40:46.933517 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 31/67] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:45 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:40:46.948530 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-17115434-6448-4672-bbda-4ca736e579ab tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:46.959882 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-17115434-6448-4672-bbda-4ca736e579ab tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.462162 Aug 04 21:40:46.960820 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 37/68] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:46 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:47.304308 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2b3cd7b7-b784-487e-a247-16dabd8a650f tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:47.305038 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2b3cd7b7-b784-487e-a247-16dabd8a650f tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:47.312397 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2b3cd7b7-b784-487e-a247-16dabd8a650f tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:47.313222 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2b3cd7b7-b784-487e-a247-16dabd8a650f tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:47.313900 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2b3cd7b7-b784-487e-a247-16dabd8a650f tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:47.314977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2b3cd7b7-b784-487e-a247-16dabd8a650f tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:47.315647 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2b3cd7b7-b784-487e-a247-16dabd8a650f tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:47.327529 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2b3cd7b7-b784-487e-a247-16dabd8a650f tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:47.518597 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2acaa108-fa95-4f0a-a1ce-f02c74f13493 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:47.522261 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-2acaa108-fa95-4f0a-a1ce-f02c74f13493 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:47.530460 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2acaa108-fa95-4f0a-a1ce-f02c74f13493 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:47.534294 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2acaa108-fa95-4f0a-a1ce-f02c74f13493 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:47.534952 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2acaa108-fa95-4f0a-a1ce-f02c74f13493 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:47.535879 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2acaa108-fa95-4f0a-a1ce-f02c74f13493 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:47.536654 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2acaa108-fa95-4f0a-a1ce-f02c74f13493 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:47.538743 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2acaa108-fa95-4f0a-a1ce-f02c74f13493 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:47.640322 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2b3cd7b7-b784-487e-a247-16dabd8a650f tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:47.654311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2b3cd7b7-b784-487e-a247-16dabd8a650f tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.353731 Aug 04 21:40:47.655590 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 32/69] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:47 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:47.688441 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2acaa108-fa95-4f0a-a1ce-f02c74f13493 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:47.700606 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2acaa108-fa95-4f0a-a1ce-f02c74f13493 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:47.703121 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2acaa108-fa95-4f0a-a1ce-f02c74f13493 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:47.704187 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2acaa108-fa95-4f0a-a1ce-f02c74f13493 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1338 microversion: 2.20 time: 0.190182 Aug 04 21:40:47.718189 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 38/70] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:40:47 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1338 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:40:47.959649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-8f7021c8-0e4a-4b9a-b453-cba21aed774a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:47.960557 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-8f7021c8-0e4a-4b9a-b453-cba21aed774a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:47.971804 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8f7021c8-0e4a-4b9a-b453-cba21aed774a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:47.972409 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8f7021c8-0e4a-4b9a-b453-cba21aed774a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:47.972931 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8f7021c8-0e4a-4b9a-b453-cba21aed774a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:47.974879 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8f7021c8-0e4a-4b9a-b453-cba21aed774a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:47.995556 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8f7021c8-0e4a-4b9a-b453-cba21aed774a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:47.996859 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8f7021c8-0e4a-4b9a-b453-cba21aed774a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:48.011890 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-2b4866f1-ba42-4947-a7c0-b57254c4e62c req-27207fad-67fe-480d-8e58-d164c4778429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80b3cb09-2341-45b6-85aa-26706dd17e65", "tag": "d31cf969-7aa9-4aed-8a90-7b1398f0f788"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:40:48.020620 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=4 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:40:48.028488 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-2b4866f1-ba42-4947-a7c0-b57254c4e62c req-27207fad-67fe-480d-8e58-d164c4778429 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:48.028974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-2b4866f1-ba42-4947-a7c0-b57254c4e62c req-27207fad-67fe-480d-8e58-d164c4778429 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:48.029409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-2b4866f1-ba42-4947-a7c0-b57254c4e62c req-27207fad-67fe-480d-8e58-d164c4778429 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:48.051862 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-2b4866f1-ba42-4947-a7c0-b57254c4e62c req-27207fad-67fe-480d-8e58-d164c4778429 service nova] Creating event network-changed:d31cf969-7aa9-4aed-8a90-7b1398f0f788 for instance 80b3cb09-2341-45b6-85aa-26706dd17e65 on hv-cinder-85220 Aug 04 21:40:48.052393 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-2b4866f1-ba42-4947-a7c0-b57254c4e62c req-27207fad-67fe-480d-8e58-d164c4778429 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=136342) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 21:40:48.052781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-2b4866f1-ba42-4947-a7c0-b57254c4e62c req-27207fad-67fe-480d-8e58-d164c4778429 service nova] Acquired lock "compute-rpcapi-router" {{(pid=136342) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 21:40:48.053850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1b9e35e0-8ef8-42ee-a755-431985c39757 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:48.054341 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1b9e35e0-8ef8-42ee-a755-431985c39757 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:48.054762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1b9e35e0-8ef8-42ee-a755-431985c39757 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:48.055482 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1b9e35e0-8ef8-42ee-a755-431985c39757 None None] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:48.055926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1b9e35e0-8ef8-42ee-a755-431985c39757 None None] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:48.059037 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1b9e35e0-8ef8-42ee-a755-431985c39757 None None] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:48.068811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.compute.rpcapi [None req-1b9e35e0-8ef8-42ee-a755-431985c39757 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 21:40:48.071690 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1b9e35e0-8ef8-42ee-a755-431985c39757 None None] Releasing lock "compute-rpcapi-router" {{(pid=136342) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 21:40:48.092762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-1b9e35e0-8ef8-42ee-a755-431985c39757 None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174327 Aug 04 21:40:48.094001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 33/71] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:40:48.099843 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-9b5b4cd0-5a94-42e9-a8fd-f95b05aacb38 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:48.100735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-9b5b4cd0-5a94-42e9-a8fd-f95b05aacb38 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:48.107857 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9b5b4cd0-5a94-42e9-a8fd-f95b05aacb38 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:48.108347 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9b5b4cd0-5a94-42e9-a8fd-f95b05aacb38 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:48.108956 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9b5b4cd0-5a94-42e9-a8fd-f95b05aacb38 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:48.109806 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9b5b4cd0-5a94-42e9-a8fd-f95b05aacb38 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:48.110447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9b5b4cd0-5a94-42e9-a8fd-f95b05aacb38 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:48.111044 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9b5b4cd0-5a94-42e9-a8fd-f95b05aacb38 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:48.241093 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8f7021c8-0e4a-4b9a-b453-cba21aed774a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:48.255913 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-8f7021c8-0e4a-4b9a-b453-cba21aed774a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.299780 Aug 04 21:40:48.269480 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 39/72] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:47 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:48.402831 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-9b5b4cd0-5a94-42e9-a8fd-f95b05aacb38 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:48.410735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-9b5b4cd0-5a94-42e9-a8fd-f95b05aacb38 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.315263 Aug 04 21:40:48.411307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 34/73] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:48 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:48.534023 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-4838f23f-99bf-4034-9a1c-3cc1e3bbb982 req-1c52df5d-17ae-44af-a769-a78facd8ebc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9770e069-e3a5-4f2e-95a2-8308c2580ec7", "tag": "a31501ea-6fef-42f4-866e-93e03aeb08b1"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:40:48.548142 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-4838f23f-99bf-4034-9a1c-3cc1e3bbb982 req-1c52df5d-17ae-44af-a769-a78facd8ebc3 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:48.548616 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-4838f23f-99bf-4034-9a1c-3cc1e3bbb982 req-1c52df5d-17ae-44af-a769-a78facd8ebc3 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:48.549287 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-4838f23f-99bf-4034-9a1c-3cc1e3bbb982 req-1c52df5d-17ae-44af-a769-a78facd8ebc3 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:48.578945 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-4838f23f-99bf-4034-9a1c-3cc1e3bbb982 req-1c52df5d-17ae-44af-a769-a78facd8ebc3 service nova] Creating event network-changed:a31501ea-6fef-42f4-866e-93e03aeb08b1 for instance 9770e069-e3a5-4f2e-95a2-8308c2580ec7 on hv-cinder-85220 Aug 04 21:40:48.579631 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-4838f23f-99bf-4034-9a1c-3cc1e3bbb982 req-1c52df5d-17ae-44af-a769-a78facd8ebc3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=136341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 21:40:48.580089 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-4838f23f-99bf-4034-9a1c-3cc1e3bbb982 req-1c52df5d-17ae-44af-a769-a78facd8ebc3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=136341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 21:40:48.581377 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7c525f54-ad19-4b90-8ec3-c0b3f4798d6e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:48.581898 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7c525f54-ad19-4b90-8ec3-c0b3f4798d6e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:48.582428 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7c525f54-ad19-4b90-8ec3-c0b3f4798d6e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:48.583289 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7c525f54-ad19-4b90-8ec3-c0b3f4798d6e None None] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:48.583855 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7c525f54-ad19-4b90-8ec3-c0b3f4798d6e None None] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:48.584658 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7c525f54-ad19-4b90-8ec3-c0b3f4798d6e None None] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:48.599552 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.compute.rpcapi [None req-7c525f54-ad19-4b90-8ec3-c0b3f4798d6e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 21:40:48.599552 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7c525f54-ad19-4b90-8ec3-c0b3f4798d6e None None] Releasing lock "compute-rpcapi-router" {{(pid=136341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 21:40:48.618696 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-7c525f54-ad19-4b90-8ec3-c0b3f4798d6e None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179410 Aug 04 21:40:48.619693 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 40/74] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:40:48.676571 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-57e24bcb-5351-4151-b1d1-2643252b5598 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:48.677212 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-57e24bcb-5351-4151-b1d1-2643252b5598 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:48.685353 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57e24bcb-5351-4151-b1d1-2643252b5598 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:48.685353 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57e24bcb-5351-4151-b1d1-2643252b5598 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:48.685353 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57e24bcb-5351-4151-b1d1-2643252b5598 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:48.685702 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57e24bcb-5351-4151-b1d1-2643252b5598 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:48.686120 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57e24bcb-5351-4151-b1d1-2643252b5598 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:48.686550 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57e24bcb-5351-4151-b1d1-2643252b5598 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:48.729827 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ab07fb31-a656-4255-a988-c2cbdda8dec5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:48.730550 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ab07fb31-a656-4255-a988-c2cbdda8dec5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:48.742191 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ab07fb31-a656-4255-a988-c2cbdda8dec5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:48.742819 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ab07fb31-a656-4255-a988-c2cbdda8dec5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:48.743330 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ab07fb31-a656-4255-a988-c2cbdda8dec5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:48.744134 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ab07fb31-a656-4255-a988-c2cbdda8dec5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:48.745432 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ab07fb31-a656-4255-a988-c2cbdda8dec5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:48.745951 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ab07fb31-a656-4255-a988-c2cbdda8dec5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:48.825784 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ab07fb31-a656-4255-a988-c2cbdda8dec5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:48.836200 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ab07fb31-a656-4255-a988-c2cbdda8dec5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:48.837769 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ab07fb31-a656-4255-a988-c2cbdda8dec5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:48.839855 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ab07fb31-a656-4255-a988-c2cbdda8dec5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1338 microversion: 2.20 time: 0.114854 Aug 04 21:40:48.844623 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 41/75] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:40:48 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1338 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:40:48.855856 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-57e24bcb-5351-4151-b1d1-2643252b5598 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:48.863760 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-57e24bcb-5351-4151-b1d1-2643252b5598 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.191235 Aug 04 21:40:48.864357 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 35/76] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:48 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:49.283925 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-548d8d73-7c72-497b-bd71-2f3ab2c1efdd tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:49.288871 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-548d8d73-7c72-497b-bd71-2f3ab2c1efdd tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:49.291428 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-548d8d73-7c72-497b-bd71-2f3ab2c1efdd tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:49.292161 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-548d8d73-7c72-497b-bd71-2f3ab2c1efdd tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:49.292600 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-548d8d73-7c72-497b-bd71-2f3ab2c1efdd tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:49.293309 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-548d8d73-7c72-497b-bd71-2f3ab2c1efdd tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:49.296159 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-548d8d73-7c72-497b-bd71-2f3ab2c1efdd tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:49.298130 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-548d8d73-7c72-497b-bd71-2f3ab2c1efdd tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:49.302812 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=100 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:40:49.434264 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-39a738e1-4026-4a81-bba3-fcd2a844920a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:49.435007 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-39a738e1-4026-4a81-bba3-fcd2a844920a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:49.441962 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-39a738e1-4026-4a81-bba3-fcd2a844920a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:49.443851 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-39a738e1-4026-4a81-bba3-fcd2a844920a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:49.444503 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-39a738e1-4026-4a81-bba3-fcd2a844920a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:49.445427 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-39a738e1-4026-4a81-bba3-fcd2a844920a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:49.445945 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-39a738e1-4026-4a81-bba3-fcd2a844920a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:49.446604 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-39a738e1-4026-4a81-bba3-fcd2a844920a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:49.466986 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-548d8d73-7c72-497b-bd71-2f3ab2c1efdd tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:49.475868 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-548d8d73-7c72-497b-bd71-2f3ab2c1efdd tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.200957 Aug 04 21:40:49.500473 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 42/77] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:49 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:49.637114 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-39a738e1-4026-4a81-bba3-fcd2a844920a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:49.644903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-39a738e1-4026-4a81-bba3-fcd2a844920a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.215899 Aug 04 21:40:49.645502 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 36/78] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:49 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:40:49.863627 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-9a0dcdda-49ba-4727-a502-e5aa4fa0e4da tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:49.865073 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-9a0dcdda-49ba-4727-a502-e5aa4fa0e4da tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:49.879510 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a0dcdda-49ba-4727-a502-e5aa4fa0e4da tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:49.880872 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a0dcdda-49ba-4727-a502-e5aa4fa0e4da tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:49.882970 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a0dcdda-49ba-4727-a502-e5aa4fa0e4da tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:49.888431 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a0dcdda-49ba-4727-a502-e5aa4fa0e4da tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:49.889404 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a0dcdda-49ba-4727-a502-e5aa4fa0e4da tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:49.893663 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a0dcdda-49ba-4727-a502-e5aa4fa0e4da tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:49.894885 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-3110561c-a242-496a-bb13-57638444b3c6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:49.895747 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-3110561c-a242-496a-bb13-57638444b3c6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:49.908709 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3110561c-a242-496a-bb13-57638444b3c6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:49.909623 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3110561c-a242-496a-bb13-57638444b3c6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:49.910640 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3110561c-a242-496a-bb13-57638444b3c6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:49.911721 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3110561c-a242-496a-bb13-57638444b3c6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:49.912824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3110561c-a242-496a-bb13-57638444b3c6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:49.913451 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3110561c-a242-496a-bb13-57638444b3c6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:50.015756 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-9a0dcdda-49ba-4727-a502-e5aa4fa0e4da tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:50.025032 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-9a0dcdda-49ba-4727-a502-e5aa4fa0e4da tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:50.033123 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-9a0dcdda-49ba-4727-a502-e5aa4fa0e4da tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:50.033123 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-9a0dcdda-49ba-4727-a502-e5aa4fa0e4da tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1338 microversion: 2.20 time: 0.169319 Aug 04 21:40:50.033123 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 43/79] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:40:49 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1338 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:40:50.117313 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-3110561c-a242-496a-bb13-57638444b3c6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:50.130757 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-3110561c-a242-496a-bb13-57638444b3c6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.238959 Aug 04 21:40:50.130757 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 37/80] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:49 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:50.505098 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d084c5ec-885d-4d60-b0bd-4f7f4c289fc3 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:50.505822 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-d084c5ec-885d-4d60-b0bd-4f7f4c289fc3 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:50.516808 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d084c5ec-885d-4d60-b0bd-4f7f4c289fc3 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:50.518490 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d084c5ec-885d-4d60-b0bd-4f7f4c289fc3 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:50.519204 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d084c5ec-885d-4d60-b0bd-4f7f4c289fc3 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:50.519938 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d084c5ec-885d-4d60-b0bd-4f7f4c289fc3 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:50.520389 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d084c5ec-885d-4d60-b0bd-4f7f4c289fc3 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:50.520914 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d084c5ec-885d-4d60-b0bd-4f7f4c289fc3 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:50.668264 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-9e24f318-7256-4d3b-bfbd-4954bae80444 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:50.668881 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-9e24f318-7256-4d3b-bfbd-4954bae80444 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:50.670991 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=26 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:40:50.676169 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9e24f318-7256-4d3b-bfbd-4954bae80444 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:50.676658 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9e24f318-7256-4d3b-bfbd-4954bae80444 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:50.678913 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9e24f318-7256-4d3b-bfbd-4954bae80444 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:50.679635 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9e24f318-7256-4d3b-bfbd-4954bae80444 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:50.680096 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9e24f318-7256-4d3b-bfbd-4954bae80444 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:50.680525 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9e24f318-7256-4d3b-bfbd-4954bae80444 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:50.725883 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d084c5ec-885d-4d60-b0bd-4f7f4c289fc3 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:50.736037 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d084c5ec-885d-4d60-b0bd-4f7f4c289fc3 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.241692 Aug 04 21:40:50.750071 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 44/81] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:50 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:50.879740 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-9e24f318-7256-4d3b-bfbd-4954bae80444 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:50.893120 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-9e24f318-7256-4d3b-bfbd-4954bae80444 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.229896 Aug 04 21:40:50.894368 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 38/82] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:50 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:51.066646 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d076af99-fa49-4ce0-b7cd-fa028f3e0aa4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:51.071078 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-d076af99-fa49-4ce0-b7cd-fa028f3e0aa4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:51.083877 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d076af99-fa49-4ce0-b7cd-fa028f3e0aa4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:51.086831 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d076af99-fa49-4ce0-b7cd-fa028f3e0aa4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:51.089220 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d076af99-fa49-4ce0-b7cd-fa028f3e0aa4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:51.116044 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d076af99-fa49-4ce0-b7cd-fa028f3e0aa4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:51.116044 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d076af99-fa49-4ce0-b7cd-fa028f3e0aa4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:51.116044 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d076af99-fa49-4ce0-b7cd-fa028f3e0aa4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:51.152992 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-bd684654-0952-4ff9-80d2-24bd9636c531 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:51.153929 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-bd684654-0952-4ff9-80d2-24bd9636c531 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:51.164712 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bd684654-0952-4ff9-80d2-24bd9636c531 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:51.167331 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bd684654-0952-4ff9-80d2-24bd9636c531 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:51.171900 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bd684654-0952-4ff9-80d2-24bd9636c531 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:51.173924 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bd684654-0952-4ff9-80d2-24bd9636c531 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:51.177012 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bd684654-0952-4ff9-80d2-24bd9636c531 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:51.178398 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bd684654-0952-4ff9-80d2-24bd9636c531 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:51.226294 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d076af99-fa49-4ce0-b7cd-fa028f3e0aa4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:51.238041 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d076af99-fa49-4ce0-b7cd-fa028f3e0aa4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:51.244839 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d076af99-fa49-4ce0-b7cd-fa028f3e0aa4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:51.251286 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d076af99-fa49-4ce0-b7cd-fa028f3e0aa4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1338 microversion: 2.20 time: 0.197659 Aug 04 21:40:51.251286 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 45/83] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:40:51 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1338 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:40:51.466220 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-bd684654-0952-4ff9-80d2-24bd9636c531 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:51.484887 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-bd684654-0952-4ff9-80d2-24bd9636c531 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.327400 Aug 04 21:40:51.495391 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 39/84] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:51 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:51.763698 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b80c1458-3de8-4231-ab4f-daa90a95618b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:51.764586 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b80c1458-3de8-4231-ab4f-daa90a95618b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:51.772895 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b80c1458-3de8-4231-ab4f-daa90a95618b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:51.773719 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b80c1458-3de8-4231-ab4f-daa90a95618b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:51.774579 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b80c1458-3de8-4231-ab4f-daa90a95618b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:51.775302 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b80c1458-3de8-4231-ab4f-daa90a95618b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:51.776349 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b80c1458-3de8-4231-ab4f-daa90a95618b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:51.778379 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b80c1458-3de8-4231-ab4f-daa90a95618b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:51.917680 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ca59e9a9-ba70-4a93-8912-b2a03b765342 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:51.918959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ca59e9a9-ba70-4a93-8912-b2a03b765342 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:51.922099 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:40:51.924917 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b80c1458-3de8-4231-ab4f-daa90a95618b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:51.925980 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ca59e9a9-ba70-4a93-8912-b2a03b765342 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:51.926942 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ca59e9a9-ba70-4a93-8912-b2a03b765342 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:51.927721 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ca59e9a9-ba70-4a93-8912-b2a03b765342 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:51.928661 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ca59e9a9-ba70-4a93-8912-b2a03b765342 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:51.929181 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ca59e9a9-ba70-4a93-8912-b2a03b765342 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:51.929808 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ca59e9a9-ba70-4a93-8912-b2a03b765342 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:51.932874 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b80c1458-3de8-4231-ab4f-daa90a95618b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.173977 Aug 04 21:40:51.933440 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 46/85] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:51 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:52.110487 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ca59e9a9-ba70-4a93-8912-b2a03b765342 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:52.116972 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=100 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:40:52.120304 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ca59e9a9-ba70-4a93-8912-b2a03b765342 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.207102 Aug 04 21:40:52.121557 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 40/86] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:51 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:40:52.272189 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-824bb4bc-496e-4bf3-b0fc-98f1bc72d09b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:52.272842 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-824bb4bc-496e-4bf3-b0fc-98f1bc72d09b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:52.276476 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=30 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:40:52.285515 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-824bb4bc-496e-4bf3-b0fc-98f1bc72d09b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:52.285515 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-824bb4bc-496e-4bf3-b0fc-98f1bc72d09b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:52.285515 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-824bb4bc-496e-4bf3-b0fc-98f1bc72d09b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:52.286414 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-824bb4bc-496e-4bf3-b0fc-98f1bc72d09b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:52.286753 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-824bb4bc-496e-4bf3-b0fc-98f1bc72d09b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:52.287429 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-824bb4bc-496e-4bf3-b0fc-98f1bc72d09b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:52.365511 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-824bb4bc-496e-4bf3-b0fc-98f1bc72d09b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:52.375099 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-824bb4bc-496e-4bf3-b0fc-98f1bc72d09b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:52.377132 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-824bb4bc-496e-4bf3-b0fc-98f1bc72d09b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:52.378456 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-824bb4bc-496e-4bf3-b0fc-98f1bc72d09b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1338 microversion: 2.20 time: 0.110918 Aug 04 21:40:52.381081 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 47/87] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:40:52 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1338 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:40:52.500083 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-cded3061-7acc-4620-bd11-7f856c5404a1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:52.500695 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-cded3061-7acc-4620-bd11-7f856c5404a1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:52.506790 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cded3061-7acc-4620-bd11-7f856c5404a1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:52.507272 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cded3061-7acc-4620-bd11-7f856c5404a1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:52.507703 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cded3061-7acc-4620-bd11-7f856c5404a1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:52.508390 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cded3061-7acc-4620-bd11-7f856c5404a1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:52.521720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cded3061-7acc-4620-bd11-7f856c5404a1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:52.521720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cded3061-7acc-4620-bd11-7f856c5404a1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:52.680801 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-cded3061-7acc-4620-bd11-7f856c5404a1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:52.689038 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-cded3061-7acc-4620-bd11-7f856c5404a1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.193228 Aug 04 21:40:52.689651 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 41/88] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:52 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:52.953948 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-50fcbd89-1f39-4e30-bd60-494470d088f4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:52.954583 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-50fcbd89-1f39-4e30-bd60-494470d088f4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:52.960576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-50fcbd89-1f39-4e30-bd60-494470d088f4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:52.961066 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-50fcbd89-1f39-4e30-bd60-494470d088f4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:52.961499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-50fcbd89-1f39-4e30-bd60-494470d088f4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:52.962239 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-50fcbd89-1f39-4e30-bd60-494470d088f4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:52.962684 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-50fcbd89-1f39-4e30-bd60-494470d088f4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:52.963347 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-50fcbd89-1f39-4e30-bd60-494470d088f4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:53.142091 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6c2e694d-cb52-48fe-a720-ad9bac6c5909 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:53.143540 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-50fcbd89-1f39-4e30-bd60-494470d088f4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:53.145682 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-6c2e694d-cb52-48fe-a720-ad9bac6c5909 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:53.152773 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6c2e694d-cb52-48fe-a720-ad9bac6c5909 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:53.153253 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6c2e694d-cb52-48fe-a720-ad9bac6c5909 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:53.153852 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6c2e694d-cb52-48fe-a720-ad9bac6c5909 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:53.154380 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-50fcbd89-1f39-4e30-bd60-494470d088f4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.204504 Aug 04 21:40:53.154602 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6c2e694d-cb52-48fe-a720-ad9bac6c5909 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:53.155198 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6c2e694d-cb52-48fe-a720-ad9bac6c5909 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:53.155772 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6c2e694d-cb52-48fe-a720-ad9bac6c5909 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:53.158498 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 48/89] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:52 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:53.332879 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6c2e694d-cb52-48fe-a720-ad9bac6c5909 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:53.342035 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-6c2e694d-cb52-48fe-a720-ad9bac6c5909 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.203623 Aug 04 21:40:53.355084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 42/90] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:53 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:53.402415 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a73a9823-6ad3-4d87-bdfc-ba60b4b78b33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:53.403035 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a73a9823-6ad3-4d87-bdfc-ba60b4b78b33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:53.409031 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a73a9823-6ad3-4d87-bdfc-ba60b4b78b33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:53.409548 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a73a9823-6ad3-4d87-bdfc-ba60b4b78b33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:53.409982 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a73a9823-6ad3-4d87-bdfc-ba60b4b78b33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:53.410737 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a73a9823-6ad3-4d87-bdfc-ba60b4b78b33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:53.411222 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a73a9823-6ad3-4d87-bdfc-ba60b4b78b33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:53.411651 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a73a9823-6ad3-4d87-bdfc-ba60b4b78b33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:53.475893 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a73a9823-6ad3-4d87-bdfc-ba60b4b78b33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:53.484045 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a73a9823-6ad3-4d87-bdfc-ba60b4b78b33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:53.485539 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a73a9823-6ad3-4d87-bdfc-ba60b4b78b33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:53.486654 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a73a9823-6ad3-4d87-bdfc-ba60b4b78b33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1338 microversion: 2.20 time: 0.088384 Aug 04 21:40:53.487202 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 49/91] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:40:53 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1338 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:40:53.710452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ca1bad8d-496b-425b-95d0-75bb6f85c75d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:53.711168 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ca1bad8d-496b-425b-95d0-75bb6f85c75d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:53.719304 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ca1bad8d-496b-425b-95d0-75bb6f85c75d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:53.719790 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ca1bad8d-496b-425b-95d0-75bb6f85c75d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:53.720453 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ca1bad8d-496b-425b-95d0-75bb6f85c75d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:53.721158 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ca1bad8d-496b-425b-95d0-75bb6f85c75d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:53.721605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ca1bad8d-496b-425b-95d0-75bb6f85c75d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:53.722891 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ca1bad8d-496b-425b-95d0-75bb6f85c75d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:53.854668 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ca1bad8d-496b-425b-95d0-75bb6f85c75d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:53.862617 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ca1bad8d-496b-425b-95d0-75bb6f85c75d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.155987 Aug 04 21:40:53.863268 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 43/92] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:53 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:54.176013 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-8f122c1b-391c-405b-a608-d12642ed551f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:54.177768 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-8f122c1b-391c-405b-a608-d12642ed551f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:54.186285 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8f122c1b-391c-405b-a608-d12642ed551f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:54.193788 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8f122c1b-391c-405b-a608-d12642ed551f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:54.193788 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8f122c1b-391c-405b-a608-d12642ed551f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:54.193788 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8f122c1b-391c-405b-a608-d12642ed551f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:54.193788 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8f122c1b-391c-405b-a608-d12642ed551f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:54.194267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8f122c1b-391c-405b-a608-d12642ed551f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:54.337197 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8f122c1b-391c-405b-a608-d12642ed551f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:54.345957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-8f122c1b-391c-405b-a608-d12642ed551f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.174985 Aug 04 21:40:54.346893 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 50/93] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:54 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:54.367723 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-56b85ed7-e37e-4cab-8777-12ed192f5a93 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:54.368942 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-56b85ed7-e37e-4cab-8777-12ed192f5a93 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:54.376077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-56b85ed7-e37e-4cab-8777-12ed192f5a93 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:54.376874 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-56b85ed7-e37e-4cab-8777-12ed192f5a93 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:54.377562 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-56b85ed7-e37e-4cab-8777-12ed192f5a93 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:54.378490 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-56b85ed7-e37e-4cab-8777-12ed192f5a93 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:54.379173 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-56b85ed7-e37e-4cab-8777-12ed192f5a93 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:54.379737 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-56b85ed7-e37e-4cab-8777-12ed192f5a93 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:54.511616 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-dbf962ec-59da-4aa4-9d3e-96d6f02a0e1a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:54.513209 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-dbf962ec-59da-4aa4-9d3e-96d6f02a0e1a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:54.521765 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dbf962ec-59da-4aa4-9d3e-96d6f02a0e1a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:54.522505 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dbf962ec-59da-4aa4-9d3e-96d6f02a0e1a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:54.523159 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dbf962ec-59da-4aa4-9d3e-96d6f02a0e1a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:54.524070 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dbf962ec-59da-4aa4-9d3e-96d6f02a0e1a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:54.524811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dbf962ec-59da-4aa4-9d3e-96d6f02a0e1a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:54.526669 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dbf962ec-59da-4aa4-9d3e-96d6f02a0e1a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:54.590877 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-56b85ed7-e37e-4cab-8777-12ed192f5a93 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:54.605031 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-56b85ed7-e37e-4cab-8777-12ed192f5a93 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.243896 Aug 04 21:40:54.606529 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 44/94] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:54 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:54.636601 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-dbf962ec-59da-4aa4-9d3e-96d6f02a0e1a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:54.654318 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-dbf962ec-59da-4aa4-9d3e-96d6f02a0e1a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:54.656021 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-dbf962ec-59da-4aa4-9d3e-96d6f02a0e1a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:54.657153 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-dbf962ec-59da-4aa4-9d3e-96d6f02a0e1a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1338 microversion: 2.20 time: 0.151965 Aug 04 21:40:54.686381 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 51/95] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:40:54 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1338 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:40:54.893093 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-65d29490-2e27-4916-bfd5-cebd261ee4b2 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:54.894022 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-65d29490-2e27-4916-bfd5-cebd261ee4b2 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:54.903698 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-65d29490-2e27-4916-bfd5-cebd261ee4b2 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:54.904187 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-65d29490-2e27-4916-bfd5-cebd261ee4b2 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:54.904801 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-65d29490-2e27-4916-bfd5-cebd261ee4b2 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:54.905599 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-65d29490-2e27-4916-bfd5-cebd261ee4b2 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:54.906230 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-65d29490-2e27-4916-bfd5-cebd261ee4b2 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:54.906824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-65d29490-2e27-4916-bfd5-cebd261ee4b2 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:55.087249 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-65d29490-2e27-4916-bfd5-cebd261ee4b2 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:55.095358 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-65d29490-2e27-4916-bfd5-cebd261ee4b2 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.215034 Aug 04 21:40:55.095929 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 45/96] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:54 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:55.373040 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ea8b83cf-bf54-4422-8555-8f1fe43f9628 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:55.374091 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ea8b83cf-bf54-4422-8555-8f1fe43f9628 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:55.381321 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ea8b83cf-bf54-4422-8555-8f1fe43f9628 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:55.382274 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ea8b83cf-bf54-4422-8555-8f1fe43f9628 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:55.386294 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ea8b83cf-bf54-4422-8555-8f1fe43f9628 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:55.386294 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ea8b83cf-bf54-4422-8555-8f1fe43f9628 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:55.386294 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ea8b83cf-bf54-4422-8555-8f1fe43f9628 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:55.386294 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ea8b83cf-bf54-4422-8555-8f1fe43f9628 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:55.543117 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ea8b83cf-bf54-4422-8555-8f1fe43f9628 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:55.550960 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ea8b83cf-bf54-4422-8555-8f1fe43f9628 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.183111 Aug 04 21:40:55.551830 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 52/97] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:55 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:55.628974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-85b04e78-df76-42b2-9288-fed3abad0c94 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:55.631371 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-85b04e78-df76-42b2-9288-fed3abad0c94 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:55.641041 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-85b04e78-df76-42b2-9288-fed3abad0c94 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:55.641534 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-85b04e78-df76-42b2-9288-fed3abad0c94 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:55.642230 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-85b04e78-df76-42b2-9288-fed3abad0c94 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:55.642924 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-85b04e78-df76-42b2-9288-fed3abad0c94 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:55.643361 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-85b04e78-df76-42b2-9288-fed3abad0c94 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:55.643779 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-85b04e78-df76-42b2-9288-fed3abad0c94 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:55.689544 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-9098fbcd-1257-46a4-a498-0c78cc2c6f72 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:55.690358 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-9098fbcd-1257-46a4-a498-0c78cc2c6f72 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:55.698028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9098fbcd-1257-46a4-a498-0c78cc2c6f72 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:55.698532 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9098fbcd-1257-46a4-a498-0c78cc2c6f72 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:55.698996 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9098fbcd-1257-46a4-a498-0c78cc2c6f72 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:55.699706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9098fbcd-1257-46a4-a498-0c78cc2c6f72 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:55.700159 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9098fbcd-1257-46a4-a498-0c78cc2c6f72 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:55.700586 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9098fbcd-1257-46a4-a498-0c78cc2c6f72 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:55.768821 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-9098fbcd-1257-46a4-a498-0c78cc2c6f72 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:55.784508 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-9098fbcd-1257-46a4-a498-0c78cc2c6f72 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:55.786983 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-9098fbcd-1257-46a4-a498-0c78cc2c6f72 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:55.788301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-9098fbcd-1257-46a4-a498-0c78cc2c6f72 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1338 microversion: 2.20 time: 0.104424 Aug 04 21:40:55.789221 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 53/98] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:40:55 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1338 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:40:55.825264 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-85b04e78-df76-42b2-9288-fed3abad0c94 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:55.835062 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-85b04e78-df76-42b2-9288-fed3abad0c94 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.210829 Aug 04 21:40:55.839950 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 46/99] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:55 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:56.117069 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-da81e06c-67e1-4704-8ff9-f6519b68c1c5 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:56.117616 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-da81e06c-67e1-4704-8ff9-f6519b68c1c5 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:56.123875 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-da81e06c-67e1-4704-8ff9-f6519b68c1c5 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:56.124359 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-da81e06c-67e1-4704-8ff9-f6519b68c1c5 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:56.124912 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-da81e06c-67e1-4704-8ff9-f6519b68c1c5 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:56.125599 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-da81e06c-67e1-4704-8ff9-f6519b68c1c5 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:56.126073 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-da81e06c-67e1-4704-8ff9-f6519b68c1c5 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:56.126497 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-da81e06c-67e1-4704-8ff9-f6519b68c1c5 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:56.267989 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-da81e06c-67e1-4704-8ff9-f6519b68c1c5 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:56.277750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-da81e06c-67e1-4704-8ff9-f6519b68c1c5 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.164778 Aug 04 21:40:56.279119 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 54/100] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:56 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:56.572936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-51dd8ae6-2100-42ef-b160-eaf7130a8999 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:56.573819 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-51dd8ae6-2100-42ef-b160-eaf7130a8999 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:56.584163 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-51dd8ae6-2100-42ef-b160-eaf7130a8999 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:56.584163 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-51dd8ae6-2100-42ef-b160-eaf7130a8999 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:56.584163 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-51dd8ae6-2100-42ef-b160-eaf7130a8999 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:56.584163 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-51dd8ae6-2100-42ef-b160-eaf7130a8999 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:56.584613 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-51dd8ae6-2100-42ef-b160-eaf7130a8999 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:56.584613 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-51dd8ae6-2100-42ef-b160-eaf7130a8999 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:56.771235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-51dd8ae6-2100-42ef-b160-eaf7130a8999 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:56.780059 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-51dd8ae6-2100-42ef-b160-eaf7130a8999 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.211483 Aug 04 21:40:56.793006 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 47/101] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:56 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:56.812094 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-dbb5b063-0a6e-4b84-88d0-e6e89ea354d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:56.812692 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-dbb5b063-0a6e-4b84-88d0-e6e89ea354d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:56.819204 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dbb5b063-0a6e-4b84-88d0-e6e89ea354d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:56.819694 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dbb5b063-0a6e-4b84-88d0-e6e89ea354d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:56.820122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dbb5b063-0a6e-4b84-88d0-e6e89ea354d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:56.821033 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dbb5b063-0a6e-4b84-88d0-e6e89ea354d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:56.821715 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dbb5b063-0a6e-4b84-88d0-e6e89ea354d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:56.823385 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dbb5b063-0a6e-4b84-88d0-e6e89ea354d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:56.859060 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-3d1cff33-659f-4713-a95f-c365fe9884ed tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:56.859668 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-3d1cff33-659f-4713-a95f-c365fe9884ed tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:56.866142 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d1cff33-659f-4713-a95f-c365fe9884ed tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:56.867136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d1cff33-659f-4713-a95f-c365fe9884ed tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:56.867796 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d1cff33-659f-4713-a95f-c365fe9884ed tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:56.868776 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d1cff33-659f-4713-a95f-c365fe9884ed tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:56.870250 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d1cff33-659f-4713-a95f-c365fe9884ed tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:56.870886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d1cff33-659f-4713-a95f-c365fe9884ed tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:56.923258 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-dbb5b063-0a6e-4b84-88d0-e6e89ea354d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:56.934448 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-dbb5b063-0a6e-4b84-88d0-e6e89ea354d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:56.936281 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-dbb5b063-0a6e-4b84-88d0-e6e89ea354d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:56.944710 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-dbb5b063-0a6e-4b84-88d0-e6e89ea354d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1338 microversion: 2.20 time: 0.129462 Aug 04 21:40:56.959059 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 55/102] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:40:56 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1338 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:40:57.107281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-3d1cff33-659f-4713-a95f-c365fe9884ed tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:57.116352 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-3d1cff33-659f-4713-a95f-c365fe9884ed tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.261003 Aug 04 21:40:57.130729 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 48/103] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:56 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:57.300350 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-db69f1b3-ddc0-4b37-befe-3f97a29505e6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:57.300791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-db69f1b3-ddc0-4b37-befe-3f97a29505e6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:57.306843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-db69f1b3-ddc0-4b37-befe-3f97a29505e6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:57.307567 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-db69f1b3-ddc0-4b37-befe-3f97a29505e6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:57.308202 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-db69f1b3-ddc0-4b37-befe-3f97a29505e6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:57.308929 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-db69f1b3-ddc0-4b37-befe-3f97a29505e6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:57.309544 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-db69f1b3-ddc0-4b37-befe-3f97a29505e6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:57.309967 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-db69f1b3-ddc0-4b37-befe-3f97a29505e6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:57.505858 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-db69f1b3-ddc0-4b37-befe-3f97a29505e6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:57.515279 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-db69f1b3-ddc0-4b37-befe-3f97a29505e6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.219090 Aug 04 21:40:57.515860 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 56/104] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:57 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:57.799756 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-c4d1decc-84c9-438e-af05-07dc2fd1bdb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:57.800383 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-c4d1decc-84c9-438e-af05-07dc2fd1bdb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:57.807598 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c4d1decc-84c9-438e-af05-07dc2fd1bdb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:57.808462 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c4d1decc-84c9-438e-af05-07dc2fd1bdb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:57.809110 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c4d1decc-84c9-438e-af05-07dc2fd1bdb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:57.815421 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c4d1decc-84c9-438e-af05-07dc2fd1bdb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:57.815888 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c4d1decc-84c9-438e-af05-07dc2fd1bdb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:57.825389 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c4d1decc-84c9-438e-af05-07dc2fd1bdb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:57.967090 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-c4d1decc-84c9-438e-af05-07dc2fd1bdb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:57.970228 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-6f9845d6-fca9-4ed6-ac11-78118f4e57a4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:57.971369 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-6f9845d6-fca9-4ed6-ac11-78118f4e57a4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:57.977908 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6f9845d6-fca9-4ed6-ac11-78118f4e57a4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:57.979624 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6f9845d6-fca9-4ed6-ac11-78118f4e57a4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:57.981105 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6f9845d6-fca9-4ed6-ac11-78118f4e57a4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:57.981224 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-c4d1decc-84c9-438e-af05-07dc2fd1bdb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.184137 Aug 04 21:40:57.981321 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6f9845d6-fca9-4ed6-ac11-78118f4e57a4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:57.981398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6f9845d6-fca9-4ed6-ac11-78118f4e57a4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:57.981960 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6f9845d6-fca9-4ed6-ac11-78118f4e57a4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:57.987564 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 49/105] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:57 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:58.057070 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6f9845d6-fca9-4ed6-ac11-78118f4e57a4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:58.066567 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6f9845d6-fca9-4ed6-ac11-78118f4e57a4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:58.074416 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6f9845d6-fca9-4ed6-ac11-78118f4e57a4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:58.074416 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-6f9845d6-fca9-4ed6-ac11-78118f4e57a4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1338 microversion: 2.20 time: 0.103328 Aug 04 21:40:58.086460 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 57/106] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:40:57 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1338 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:40:58.146819 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-5aec0f40-9da9-4936-b13e-6b61dab408b4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:58.147593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-5aec0f40-9da9-4936-b13e-6b61dab408b4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:58.150896 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=8 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:40:58.170419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5aec0f40-9da9-4936-b13e-6b61dab408b4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:58.173591 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5aec0f40-9da9-4936-b13e-6b61dab408b4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:58.174327 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5aec0f40-9da9-4936-b13e-6b61dab408b4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:58.175098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5aec0f40-9da9-4936-b13e-6b61dab408b4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:58.175587 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5aec0f40-9da9-4936-b13e-6b61dab408b4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:58.176068 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5aec0f40-9da9-4936-b13e-6b61dab408b4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:58.359662 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-5aec0f40-9da9-4936-b13e-6b61dab408b4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:58.368168 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-5aec0f40-9da9-4936-b13e-6b61dab408b4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.230201 Aug 04 21:40:58.369564 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 50/107] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:58 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:58.552021 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c28d9099-8ebc-4e8b-9b14-ad41e1aea10e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:58.552985 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c28d9099-8ebc-4e8b-9b14-ad41e1aea10e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:58.563993 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c28d9099-8ebc-4e8b-9b14-ad41e1aea10e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:58.566958 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c28d9099-8ebc-4e8b-9b14-ad41e1aea10e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:58.567623 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c28d9099-8ebc-4e8b-9b14-ad41e1aea10e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:58.574331 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c28d9099-8ebc-4e8b-9b14-ad41e1aea10e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:58.575024 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c28d9099-8ebc-4e8b-9b14-ad41e1aea10e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:58.575663 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c28d9099-8ebc-4e8b-9b14-ad41e1aea10e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:58.786118 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-c28d9099-8ebc-4e8b-9b14-ad41e1aea10e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:58.789990 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=100 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:40:58.795355 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c28d9099-8ebc-4e8b-9b14-ad41e1aea10e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.261554 Aug 04 21:40:58.796062 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 58/108] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:58 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:59.002303 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-aea01c99-0599-41b3-be91-f08a3b61ad9a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:59.004657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-aea01c99-0599-41b3-be91-f08a3b61ad9a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:59.010086 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aea01c99-0599-41b3-be91-f08a3b61ad9a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:59.010752 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aea01c99-0599-41b3-be91-f08a3b61ad9a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:59.011243 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aea01c99-0599-41b3-be91-f08a3b61ad9a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:59.011947 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aea01c99-0599-41b3-be91-f08a3b61ad9a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:59.012394 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aea01c99-0599-41b3-be91-f08a3b61ad9a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:59.012816 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aea01c99-0599-41b3-be91-f08a3b61ad9a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:59.113307 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-188a1b74-77b9-4e8e-b839-6a44207aca90 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:59.113947 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-188a1b74-77b9-4e8e-b839-6a44207aca90 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:59.137133 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-188a1b74-77b9-4e8e-b839-6a44207aca90 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:59.138836 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-188a1b74-77b9-4e8e-b839-6a44207aca90 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:59.139688 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-188a1b74-77b9-4e8e-b839-6a44207aca90 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:59.147996 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-188a1b74-77b9-4e8e-b839-6a44207aca90 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:59.149624 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-188a1b74-77b9-4e8e-b839-6a44207aca90 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:59.155201 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-188a1b74-77b9-4e8e-b839-6a44207aca90 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:59.226592 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-aea01c99-0599-41b3-be91-f08a3b61ad9a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:59.289595 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-aea01c99-0599-41b3-be91-f08a3b61ad9a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.238122 Aug 04 21:40:59.289595 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 51/109] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:58 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:59.290210 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-188a1b74-77b9-4e8e-b839-6a44207aca90 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:59.303244 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-188a1b74-77b9-4e8e-b839-6a44207aca90 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:59.304849 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-188a1b74-77b9-4e8e-b839-6a44207aca90 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:59.305982 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-188a1b74-77b9-4e8e-b839-6a44207aca90 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1338 microversion: 2.20 time: 0.218066 Aug 04 21:40:59.321866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 59/110] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:40:59 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1338 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:40:59.394759 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6f74a730-4772-4426-9bad-3ccfb3472d06 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:59.511232 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-6f74a730-4772-4426-9bad-3ccfb3472d06 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:59.511232 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6f74a730-4772-4426-9bad-3ccfb3472d06 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:59.511232 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6f74a730-4772-4426-9bad-3ccfb3472d06 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:59.511232 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6f74a730-4772-4426-9bad-3ccfb3472d06 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:59.512386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6f74a730-4772-4426-9bad-3ccfb3472d06 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:59.512386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6f74a730-4772-4426-9bad-3ccfb3472d06 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:59.512386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6f74a730-4772-4426-9bad-3ccfb3472d06 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:59.537045 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6f74a730-4772-4426-9bad-3ccfb3472d06 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:40:59.551338 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-6f74a730-4772-4426-9bad-3ccfb3472d06 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.154969 Aug 04 21:40:59.551338 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 52/111] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:59 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:40:59.863550 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-9a83cede-8f43-420d-a904-9376f336d6ea tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:40:59.863550 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-9a83cede-8f43-420d-a904-9376f336d6ea tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:40:59.863550 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=2 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:40:59.863550 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a83cede-8f43-420d-a904-9376f336d6ea tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:59.863550 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a83cede-8f43-420d-a904-9376f336d6ea tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:59.864372 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a83cede-8f43-420d-a904-9376f336d6ea tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:40:59.864372 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a83cede-8f43-420d-a904-9376f336d6ea tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:40:59.864372 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a83cede-8f43-420d-a904-9376f336d6ea tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:40:59.864372 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a83cede-8f43-420d-a904-9376f336d6ea tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:00.309724 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-9c0c4cae-82db-4019-bf13-633902a0329c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:00.310395 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-9c0c4cae-82db-4019-bf13-633902a0329c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:00.325066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9c0c4cae-82db-4019-bf13-633902a0329c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:00.325561 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9c0c4cae-82db-4019-bf13-633902a0329c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:00.325993 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9c0c4cae-82db-4019-bf13-633902a0329c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:00.326894 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9c0c4cae-82db-4019-bf13-633902a0329c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:00.327366 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9c0c4cae-82db-4019-bf13-633902a0329c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:00.327788 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9c0c4cae-82db-4019-bf13-633902a0329c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:00.514043 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-9a83cede-8f43-420d-a904-9376f336d6ea tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:00.524968 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-9a83cede-8f43-420d-a904-9376f336d6ea tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.711942 Aug 04 21:41:00.526853 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 60/112] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:40:59 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:00.542239 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-db581be5-ba78-4195-a460-66ecad2fb8fc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:00.543112 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-db581be5-ba78-4195-a460-66ecad2fb8fc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:00.551258 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-db581be5-ba78-4195-a460-66ecad2fb8fc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:00.551744 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-db581be5-ba78-4195-a460-66ecad2fb8fc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:00.552167 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-db581be5-ba78-4195-a460-66ecad2fb8fc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:00.552854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-db581be5-ba78-4195-a460-66ecad2fb8fc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:00.553294 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-db581be5-ba78-4195-a460-66ecad2fb8fc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:00.553707 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-db581be5-ba78-4195-a460-66ecad2fb8fc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:00.689734 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-db581be5-ba78-4195-a460-66ecad2fb8fc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:00.699087 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-db581be5-ba78-4195-a460-66ecad2fb8fc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:00.701732 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-db581be5-ba78-4195-a460-66ecad2fb8fc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:00.702989 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-db581be5-ba78-4195-a460-66ecad2fb8fc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1338 microversion: 2.20 time: 0.174913 Aug 04 21:41:00.703799 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 61/113] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:00 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1338 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:00.722054 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a2f854f0-0362-4304-a035-323e6f63ebe9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:00.723040 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a2f854f0-0362-4304-a035-323e6f63ebe9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:00.729936 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a2f854f0-0362-4304-a035-323e6f63ebe9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:00.730958 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a2f854f0-0362-4304-a035-323e6f63ebe9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:00.731507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a2f854f0-0362-4304-a035-323e6f63ebe9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:00.732390 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a2f854f0-0362-4304-a035-323e6f63ebe9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:00.733295 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a2f854f0-0362-4304-a035-323e6f63ebe9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:00.733817 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a2f854f0-0362-4304-a035-323e6f63ebe9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:00.770320 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-9c0c4cae-82db-4019-bf13-633902a0329c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:00.779489 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-9c0c4cae-82db-4019-bf13-633902a0329c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.475371 Aug 04 21:41:00.780325 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 53/114] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:00 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:00.928641 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a2f854f0-0362-4304-a035-323e6f63ebe9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:00.936412 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a2f854f0-0362-4304-a035-323e6f63ebe9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.231448 Aug 04 21:41:00.936973 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 62/115] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:00 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:01.547582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f83bc14b-40de-44d4-acaf-28314ee11936 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:01.548195 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-f83bc14b-40de-44d4-acaf-28314ee11936 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:01.565370 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f83bc14b-40de-44d4-acaf-28314ee11936 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:01.565873 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f83bc14b-40de-44d4-acaf-28314ee11936 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:01.566782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f83bc14b-40de-44d4-acaf-28314ee11936 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:01.569285 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f83bc14b-40de-44d4-acaf-28314ee11936 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:01.569740 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f83bc14b-40de-44d4-acaf-28314ee11936 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:01.573296 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f83bc14b-40de-44d4-acaf-28314ee11936 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:01.730544 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-1a50dd97-006f-42a4-8271-a23d63638f91 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:01.732163 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-1a50dd97-006f-42a4-8271-a23d63638f91 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:01.738965 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1a50dd97-006f-42a4-8271-a23d63638f91 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:01.739712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1a50dd97-006f-42a4-8271-a23d63638f91 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:01.740336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1a50dd97-006f-42a4-8271-a23d63638f91 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:01.741259 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1a50dd97-006f-42a4-8271-a23d63638f91 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:01.742197 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1a50dd97-006f-42a4-8271-a23d63638f91 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:01.742819 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1a50dd97-006f-42a4-8271-a23d63638f91 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:01.866672 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-1a50dd97-006f-42a4-8271-a23d63638f91 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:01.875754 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-1a50dd97-006f-42a4-8271-a23d63638f91 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:01.877905 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-1a50dd97-006f-42a4-8271-a23d63638f91 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:01.879223 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-1a50dd97-006f-42a4-8271-a23d63638f91 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1338 microversion: 2.20 time: 0.153074 Aug 04 21:41:01.879932 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 63/116] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:01 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1338 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:01.885776 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-e7eebc5a-de07-4f4b-8665-f9f98bf33bd5 req-52ad0660-2776-4897-ae5a-6cf38ccd7113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbeea630-d67b-4f89-a329-c7066d506126", "tag": "b245eeb4-95cf-45b5-8d69-591f776623e4"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:41:01.895437 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-e7eebc5a-de07-4f4b-8665-f9f98bf33bd5 req-52ad0660-2776-4897-ae5a-6cf38ccd7113 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:01.896150 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-e7eebc5a-de07-4f4b-8665-f9f98bf33bd5 req-52ad0660-2776-4897-ae5a-6cf38ccd7113 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:01.896739 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-e7eebc5a-de07-4f4b-8665-f9f98bf33bd5 req-52ad0660-2776-4897-ae5a-6cf38ccd7113 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:01.909713 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-e7eebc5a-de07-4f4b-8665-f9f98bf33bd5 req-52ad0660-2776-4897-ae5a-6cf38ccd7113 service nova] Creating event network-changed:b245eeb4-95cf-45b5-8d69-591f776623e4 for instance dbeea630-d67b-4f89-a329-c7066d506126 on hv-cinder-85220 Aug 04 21:41:01.914430 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-e7eebc5a-de07-4f4b-8665-f9f98bf33bd5 req-52ad0660-2776-4897-ae5a-6cf38ccd7113 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033190 Aug 04 21:41:01.915029 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 64/117] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:41:01.922298 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-11f78b96-17f4-4bd0-80c2-1628cadb29f9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:01.922995 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-11f78b96-17f4-4bd0-80c2-1628cadb29f9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:01.929377 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-11f78b96-17f4-4bd0-80c2-1628cadb29f9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:01.930082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-11f78b96-17f4-4bd0-80c2-1628cadb29f9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:01.930672 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-11f78b96-17f4-4bd0-80c2-1628cadb29f9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:01.933002 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-11f78b96-17f4-4bd0-80c2-1628cadb29f9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:01.933613 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-11f78b96-17f4-4bd0-80c2-1628cadb29f9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:01.934237 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-11f78b96-17f4-4bd0-80c2-1628cadb29f9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:01.977383 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-f83bc14b-40de-44d4-acaf-28314ee11936 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:01.986264 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-f83bc14b-40de-44d4-acaf-28314ee11936 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.442352 Aug 04 21:41:01.987047 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 54/118] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:01 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:01.992499 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-fe871883-7b2d-4489-94ed-c2ed3df1cbc7 req-60a532db-3d94-4efe-9d27-26ac792854db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf234f88-9a79-4880-92c5-4d2a1c1c379f", "tag": "2a939ca2-97e4-4f58-a55a-e99d3c75b212"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:41:02.003461 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-fe871883-7b2d-4489-94ed-c2ed3df1cbc7 req-60a532db-3d94-4efe-9d27-26ac792854db service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:02.004180 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-fe871883-7b2d-4489-94ed-c2ed3df1cbc7 req-60a532db-3d94-4efe-9d27-26ac792854db service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:02.004600 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-fe871883-7b2d-4489-94ed-c2ed3df1cbc7 req-60a532db-3d94-4efe-9d27-26ac792854db service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:02.016210 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-fe871883-7b2d-4489-94ed-c2ed3df1cbc7 req-60a532db-3d94-4efe-9d27-26ac792854db service nova] Creating event network-changed:2a939ca2-97e4-4f58-a55a-e99d3c75b212 for instance cf234f88-9a79-4880-92c5-4d2a1c1c379f on hv-cinder-85220 Aug 04 21:41:02.021328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-fe871883-7b2d-4489-94ed-c2ed3df1cbc7 req-60a532db-3d94-4efe-9d27-26ac792854db service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032709 Aug 04 21:41:02.022372 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 55/119] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:41:02.030046 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-808224e7-a4be-469a-9844-341e3621267d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:02.030741 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-808224e7-a4be-469a-9844-341e3621267d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:02.037362 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-808224e7-a4be-469a-9844-341e3621267d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:02.037848 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-808224e7-a4be-469a-9844-341e3621267d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:02.038299 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-808224e7-a4be-469a-9844-341e3621267d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:02.039094 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-808224e7-a4be-469a-9844-341e3621267d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:02.039443 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-808224e7-a4be-469a-9844-341e3621267d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:02.042626 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-808224e7-a4be-469a-9844-341e3621267d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:02.100511 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-11f78b96-17f4-4bd0-80c2-1628cadb29f9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:02.111129 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-11f78b96-17f4-4bd0-80c2-1628cadb29f9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.194628 Aug 04 21:41:02.112230 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 65/120] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:01 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:02.452138 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-808224e7-a4be-469a-9844-341e3621267d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:02.459891 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-808224e7-a4be-469a-9844-341e3621267d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.436310 Aug 04 21:41:02.460453 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 56/121] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:02 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:02.905380 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e50f9298-cff1-4ea0-98df-2912e545c6aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:02.906942 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e50f9298-cff1-4ea0-98df-2912e545c6aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:02.914375 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e50f9298-cff1-4ea0-98df-2912e545c6aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:02.915145 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e50f9298-cff1-4ea0-98df-2912e545c6aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:02.916793 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e50f9298-cff1-4ea0-98df-2912e545c6aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:02.917907 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e50f9298-cff1-4ea0-98df-2912e545c6aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:02.918563 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e50f9298-cff1-4ea0-98df-2912e545c6aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:02.918996 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e50f9298-cff1-4ea0-98df-2912e545c6aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:03.012866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-28ed5571-64bb-49e0-8e5a-dba929b6cf71 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:03.014063 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-28ed5571-64bb-49e0-8e5a-dba929b6cf71 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:03.021590 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-28ed5571-64bb-49e0-8e5a-dba929b6cf71 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:03.023038 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-28ed5571-64bb-49e0-8e5a-dba929b6cf71 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:03.024060 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-28ed5571-64bb-49e0-8e5a-dba929b6cf71 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:03.024836 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-28ed5571-64bb-49e0-8e5a-dba929b6cf71 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:03.025523 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-28ed5571-64bb-49e0-8e5a-dba929b6cf71 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:03.026246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-28ed5571-64bb-49e0-8e5a-dba929b6cf71 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:03.199726 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e50f9298-cff1-4ea0-98df-2912e545c6aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:03.207083 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e50f9298-cff1-4ea0-98df-2912e545c6aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:03.208796 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e50f9298-cff1-4ea0-98df-2912e545c6aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:03.209913 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e50f9298-cff1-4ea0-98df-2912e545c6aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.310732 Aug 04 21:41:03.210900 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 66/122] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:02 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:03.215934 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-679365a4-0fbd-4bd9-aef3-38276d85603f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:03.216543 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-679365a4-0fbd-4bd9-aef3-38276d85603f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:03.222496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-679365a4-0fbd-4bd9-aef3-38276d85603f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:03.222984 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-679365a4-0fbd-4bd9-aef3-38276d85603f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:03.223452 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-679365a4-0fbd-4bd9-aef3-38276d85603f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:03.224194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-679365a4-0fbd-4bd9-aef3-38276d85603f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:03.224645 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-679365a4-0fbd-4bd9-aef3-38276d85603f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:03.225065 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-679365a4-0fbd-4bd9-aef3-38276d85603f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:03.304174 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-28ed5571-64bb-49e0-8e5a-dba929b6cf71 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:03.318087 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-28ed5571-64bb-49e0-8e5a-dba929b6cf71 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.313618 Aug 04 21:41:03.319002 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 57/123] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:03 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:03.367759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-679365a4-0fbd-4bd9-aef3-38276d85603f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:03.376370 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-679365a4-0fbd-4bd9-aef3-38276d85603f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.164078 Aug 04 21:41:03.376763 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 67/124] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:03 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:03.482131 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-7c178569-dad5-47d0-968b-2883fc2fcf3a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:03.482736 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7c178569-dad5-47d0-968b-2883fc2fcf3a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:03.489096 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c178569-dad5-47d0-968b-2883fc2fcf3a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:03.489628 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c178569-dad5-47d0-968b-2883fc2fcf3a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:03.490022 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c178569-dad5-47d0-968b-2883fc2fcf3a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:03.490761 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c178569-dad5-47d0-968b-2883fc2fcf3a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:03.491206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c178569-dad5-47d0-968b-2883fc2fcf3a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:03.491621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c178569-dad5-47d0-968b-2883fc2fcf3a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:03.497129 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=100 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:41:03.725390 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7c178569-dad5-47d0-968b-2883fc2fcf3a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:03.734118 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-7c178569-dad5-47d0-968b-2883fc2fcf3a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.256467 Aug 04 21:41:03.734941 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 58/125] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:03 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:04.037951 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-22f46758-24e5-488a-8afd-37a5f0960907 req-6d14b114-aec4-4068-8eef-6a232e6a2a15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87934a42-5a51-4ba4-81ed-d07b785bc090", "tag": "970090cc-8601-489b-8105-e93f171c77d4"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:41:04.047938 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-22f46758-24e5-488a-8afd-37a5f0960907 req-6d14b114-aec4-4068-8eef-6a232e6a2a15 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:04.048407 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-22f46758-24e5-488a-8afd-37a5f0960907 req-6d14b114-aec4-4068-8eef-6a232e6a2a15 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:04.048880 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-22f46758-24e5-488a-8afd-37a5f0960907 req-6d14b114-aec4-4068-8eef-6a232e6a2a15 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:04.060469 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-22f46758-24e5-488a-8afd-37a5f0960907 req-6d14b114-aec4-4068-8eef-6a232e6a2a15 service nova] Creating event network-changed:970090cc-8601-489b-8105-e93f171c77d4 for instance 87934a42-5a51-4ba4-81ed-d07b785bc090 on hv-cinder-85220 Aug 04 21:41:04.065540 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-22f46758-24e5-488a-8afd-37a5f0960907 req-6d14b114-aec4-4068-8eef-6a232e6a2a15 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031291 Aug 04 21:41:04.066262 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 68/126] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:41:04.236950 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4942368e-b113-4da4-b2b4-5b4f899f99be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:04.237551 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4942368e-b113-4da4-b2b4-5b4f899f99be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:04.244280 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4942368e-b113-4da4-b2b4-5b4f899f99be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:04.245598 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4942368e-b113-4da4-b2b4-5b4f899f99be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:04.246217 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4942368e-b113-4da4-b2b4-5b4f899f99be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:04.247064 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4942368e-b113-4da4-b2b4-5b4f899f99be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:04.247665 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4942368e-b113-4da4-b2b4-5b4f899f99be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:04.248148 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4942368e-b113-4da4-b2b4-5b4f899f99be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:04.341502 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-5f7f98f3-7cd1-40a4-a22a-b3a245eb975d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:04.342500 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-5f7f98f3-7cd1-40a4-a22a-b3a245eb975d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:04.350121 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5f7f98f3-7cd1-40a4-a22a-b3a245eb975d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:04.350822 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5f7f98f3-7cd1-40a4-a22a-b3a245eb975d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:04.351253 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5f7f98f3-7cd1-40a4-a22a-b3a245eb975d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:04.351936 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5f7f98f3-7cd1-40a4-a22a-b3a245eb975d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:04.352522 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5f7f98f3-7cd1-40a4-a22a-b3a245eb975d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:04.362948 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5f7f98f3-7cd1-40a4-a22a-b3a245eb975d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:04.394982 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4942368e-b113-4da4-b2b4-5b4f899f99be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:04.403969 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4942368e-b113-4da4-b2b4-5b4f899f99be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:04.405472 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4942368e-b113-4da4-b2b4-5b4f899f99be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:04.406783 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4942368e-b113-4da4-b2b4-5b4f899f99be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.174121 Aug 04 21:41:04.407364 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 59/127] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:04 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:04.412230 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6a525de8-87a5-42f2-ad76-68dece3ddacb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:04.412829 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-6a525de8-87a5-42f2-ad76-68dece3ddacb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:04.420114 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6a525de8-87a5-42f2-ad76-68dece3ddacb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:04.423851 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6a525de8-87a5-42f2-ad76-68dece3ddacb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:04.423851 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6a525de8-87a5-42f2-ad76-68dece3ddacb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:04.423851 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6a525de8-87a5-42f2-ad76-68dece3ddacb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:04.423851 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6a525de8-87a5-42f2-ad76-68dece3ddacb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:04.424241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6a525de8-87a5-42f2-ad76-68dece3ddacb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:04.497914 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5f7f98f3-7cd1-40a4-a22a-b3a245eb975d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:04.505333 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-5f7f98f3-7cd1-40a4-a22a-b3a245eb975d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.169905 Aug 04 21:41:04.509501 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 69/128] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:04 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:04.558203 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6a525de8-87a5-42f2-ad76-68dece3ddacb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:04.567183 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-6a525de8-87a5-42f2-ad76-68dece3ddacb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.157487 Aug 04 21:41:04.567183 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 60/129] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:04 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:04.761461 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-70e978ca-e349-406a-a54d-cb29875bbd89 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:04.762094 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-70e978ca-e349-406a-a54d-cb29875bbd89 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:04.768225 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-70e978ca-e349-406a-a54d-cb29875bbd89 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:04.768766 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-70e978ca-e349-406a-a54d-cb29875bbd89 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:04.769194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-70e978ca-e349-406a-a54d-cb29875bbd89 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:04.769878 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-70e978ca-e349-406a-a54d-cb29875bbd89 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:04.770367 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-70e978ca-e349-406a-a54d-cb29875bbd89 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:04.770781 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-70e978ca-e349-406a-a54d-cb29875bbd89 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:04.917141 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-70e978ca-e349-406a-a54d-cb29875bbd89 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:04.924560 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-70e978ca-e349-406a-a54d-cb29875bbd89 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.167580 Aug 04 21:41:04.925218 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 70/130] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:04 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:05.429437 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-0e71189a-f905-4104-9efa-52ff881ad6e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:05.430406 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-0e71189a-f905-4104-9efa-52ff881ad6e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:05.436980 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0e71189a-f905-4104-9efa-52ff881ad6e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:05.437461 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0e71189a-f905-4104-9efa-52ff881ad6e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:05.437891 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0e71189a-f905-4104-9efa-52ff881ad6e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:05.438625 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0e71189a-f905-4104-9efa-52ff881ad6e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:05.439057 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0e71189a-f905-4104-9efa-52ff881ad6e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:05.439483 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0e71189a-f905-4104-9efa-52ff881ad6e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:05.528704 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-637c49f7-4357-4c06-8aab-3d7a904bb7b6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:05.529877 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-637c49f7-4357-4c06-8aab-3d7a904bb7b6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:05.536324 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-637c49f7-4357-4c06-8aab-3d7a904bb7b6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:05.536815 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-637c49f7-4357-4c06-8aab-3d7a904bb7b6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:05.537248 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-637c49f7-4357-4c06-8aab-3d7a904bb7b6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:05.537938 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-637c49f7-4357-4c06-8aab-3d7a904bb7b6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:05.538418 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-637c49f7-4357-4c06-8aab-3d7a904bb7b6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:05.538839 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-637c49f7-4357-4c06-8aab-3d7a904bb7b6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:05.569795 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0e71189a-f905-4104-9efa-52ff881ad6e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:05.579051 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0e71189a-f905-4104-9efa-52ff881ad6e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:05.580627 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0e71189a-f905-4104-9efa-52ff881ad6e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:05.582554 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-0e71189a-f905-4104-9efa-52ff881ad6e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.156359 Aug 04 21:41:05.582554 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 61/131] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:05 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:05.587896 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-fd17abe3-e69e-445d-87be-a786f217461e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:05.588508 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-fd17abe3-e69e-445d-87be-a786f217461e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:05.595107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fd17abe3-e69e-445d-87be-a786f217461e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:05.595591 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fd17abe3-e69e-445d-87be-a786f217461e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:05.596024 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fd17abe3-e69e-445d-87be-a786f217461e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:05.596713 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fd17abe3-e69e-445d-87be-a786f217461e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:05.597163 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fd17abe3-e69e-445d-87be-a786f217461e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:05.597584 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fd17abe3-e69e-445d-87be-a786f217461e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:05.708791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-637c49f7-4357-4c06-8aab-3d7a904bb7b6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:05.716856 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-637c49f7-4357-4c06-8aab-3d7a904bb7b6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.193402 Aug 04 21:41:05.717286 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 71/132] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:05 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:05.810034 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-fd17abe3-e69e-445d-87be-a786f217461e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:05.817519 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-fd17abe3-e69e-445d-87be-a786f217461e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.234176 Aug 04 21:41:05.818108 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 62/133] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:05 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:05.944757 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f2948caa-8137-4345-bcf0-0aebd680bc08 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:05.945312 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-f2948caa-8137-4345-bcf0-0aebd680bc08 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:05.951197 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f2948caa-8137-4345-bcf0-0aebd680bc08 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:05.951671 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f2948caa-8137-4345-bcf0-0aebd680bc08 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:05.952095 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f2948caa-8137-4345-bcf0-0aebd680bc08 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:05.952772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f2948caa-8137-4345-bcf0-0aebd680bc08 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:05.953367 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f2948caa-8137-4345-bcf0-0aebd680bc08 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:05.953930 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f2948caa-8137-4345-bcf0-0aebd680bc08 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:06.086562 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f2948caa-8137-4345-bcf0-0aebd680bc08 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:06.094674 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f2948caa-8137-4345-bcf0-0aebd680bc08 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.153927 Aug 04 21:41:06.095299 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 72/134] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:05 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:06.605381 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-7fe3cbe9-24af-4794-95cf-1608ea702c9e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:06.606072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7fe3cbe9-24af-4794-95cf-1608ea702c9e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:06.612002 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7fe3cbe9-24af-4794-95cf-1608ea702c9e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:06.612560 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7fe3cbe9-24af-4794-95cf-1608ea702c9e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:06.613173 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7fe3cbe9-24af-4794-95cf-1608ea702c9e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:06.613927 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7fe3cbe9-24af-4794-95cf-1608ea702c9e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:06.614468 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7fe3cbe9-24af-4794-95cf-1608ea702c9e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:06.614959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7fe3cbe9-24af-4794-95cf-1608ea702c9e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:06.740503 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-86d8decd-1591-4187-aa0a-38db4a644248 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:06.741015 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-86d8decd-1591-4187-aa0a-38db4a644248 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:06.748022 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-86d8decd-1591-4187-aa0a-38db4a644248 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:06.748022 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-86d8decd-1591-4187-aa0a-38db4a644248 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:06.748933 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-86d8decd-1591-4187-aa0a-38db4a644248 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:06.749620 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-86d8decd-1591-4187-aa0a-38db4a644248 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:06.750084 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-86d8decd-1591-4187-aa0a-38db4a644248 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:06.750508 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-86d8decd-1591-4187-aa0a-38db4a644248 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:06.752630 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7fe3cbe9-24af-4794-95cf-1608ea702c9e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:06.761111 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7fe3cbe9-24af-4794-95cf-1608ea702c9e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:06.762994 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7fe3cbe9-24af-4794-95cf-1608ea702c9e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:06.764201 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-7fe3cbe9-24af-4794-95cf-1608ea702c9e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.163420 Aug 04 21:41:06.782058 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 63/135] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:06 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:06.838995 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d67dfee1-c477-43a8-b206-eff303fd89d1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:06.839903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d67dfee1-c477-43a8-b206-eff303fd89d1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:06.846624 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d67dfee1-c477-43a8-b206-eff303fd89d1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:06.847186 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d67dfee1-c477-43a8-b206-eff303fd89d1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:06.847883 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d67dfee1-c477-43a8-b206-eff303fd89d1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:06.848848 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d67dfee1-c477-43a8-b206-eff303fd89d1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:06.849392 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d67dfee1-c477-43a8-b206-eff303fd89d1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:06.849927 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d67dfee1-c477-43a8-b206-eff303fd89d1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:06.917170 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-86d8decd-1591-4187-aa0a-38db4a644248 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:06.918388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-86d8decd-1591-4187-aa0a-38db4a644248 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.181731 Aug 04 21:41:06.919651 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 73/136] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:06 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:06.999028 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d67dfee1-c477-43a8-b206-eff303fd89d1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:07.006861 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d67dfee1-c477-43a8-b206-eff303fd89d1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.172443 Aug 04 21:41:07.007428 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 64/137] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:06 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:07.115489 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-abb0d18b-fc14-43f6-bbe5-b8ab48dba47e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:07.118072 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-abb0d18b-fc14-43f6-bbe5-b8ab48dba47e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:07.122404 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-abb0d18b-fc14-43f6-bbe5-b8ab48dba47e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:07.122888 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-abb0d18b-fc14-43f6-bbe5-b8ab48dba47e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:07.123320 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-abb0d18b-fc14-43f6-bbe5-b8ab48dba47e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:07.124015 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-abb0d18b-fc14-43f6-bbe5-b8ab48dba47e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:07.124465 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-abb0d18b-fc14-43f6-bbe5-b8ab48dba47e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:07.124883 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-abb0d18b-fc14-43f6-bbe5-b8ab48dba47e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:07.263090 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-abb0d18b-fc14-43f6-bbe5-b8ab48dba47e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:07.270551 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-abb0d18b-fc14-43f6-bbe5-b8ab48dba47e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.158830 Aug 04 21:41:07.271163 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 74/138] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:07 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:07.793199 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-27fc7ae4-c0c1-4085-bb94-f35c6823bc40 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:07.793836 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-27fc7ae4-c0c1-4085-bb94-f35c6823bc40 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:07.800338 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-27fc7ae4-c0c1-4085-bb94-f35c6823bc40 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:07.800919 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-27fc7ae4-c0c1-4085-bb94-f35c6823bc40 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:07.801410 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-27fc7ae4-c0c1-4085-bb94-f35c6823bc40 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:07.802201 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-27fc7ae4-c0c1-4085-bb94-f35c6823bc40 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:07.802641 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-27fc7ae4-c0c1-4085-bb94-f35c6823bc40 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:07.803055 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-27fc7ae4-c0c1-4085-bb94-f35c6823bc40 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:07.941689 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-7b273375-2b06-4bcc-b673-77c391ce297c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:07.944886 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-7b273375-2b06-4bcc-b673-77c391ce297c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:07.946356 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-27fc7ae4-c0c1-4085-bb94-f35c6823bc40 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:07.960923 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7b273375-2b06-4bcc-b673-77c391ce297c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:07.961599 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7b273375-2b06-4bcc-b673-77c391ce297c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:07.962799 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7b273375-2b06-4bcc-b673-77c391ce297c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:07.964541 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-27fc7ae4-c0c1-4085-bb94-f35c6823bc40 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:07.965148 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7b273375-2b06-4bcc-b673-77c391ce297c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:07.966529 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7b273375-2b06-4bcc-b673-77c391ce297c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:07.967769 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-27fc7ae4-c0c1-4085-bb94-f35c6823bc40 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:07.968367 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7b273375-2b06-4bcc-b673-77c391ce297c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:07.973383 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-27fc7ae4-c0c1-4085-bb94-f35c6823bc40 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.184162 Aug 04 21:41:07.974230 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 65/139] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:07 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:08.028192 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-435054af-3396-4e24-857d-1ac860814a1b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:08.028793 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-435054af-3396-4e24-857d-1ac860814a1b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:08.034699 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-435054af-3396-4e24-857d-1ac860814a1b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:08.035178 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-435054af-3396-4e24-857d-1ac860814a1b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:08.035608 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-435054af-3396-4e24-857d-1ac860814a1b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:08.036297 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-435054af-3396-4e24-857d-1ac860814a1b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:08.036751 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-435054af-3396-4e24-857d-1ac860814a1b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:08.037169 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-435054af-3396-4e24-857d-1ac860814a1b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:08.110222 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-7b273375-2b06-4bcc-b673-77c391ce297c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:08.118629 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-7b273375-2b06-4bcc-b673-77c391ce297c tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.183309 Aug 04 21:41:08.120038 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 75/140] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:07 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:08.171061 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-435054af-3396-4e24-857d-1ac860814a1b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:08.179683 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-435054af-3396-4e24-857d-1ac860814a1b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.155069 Aug 04 21:41:08.179683 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 66/141] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:08 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:08.290813 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-9f27c59d-4ca3-43e3-ba80-e9d0fc1327dc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:08.292124 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-9f27c59d-4ca3-43e3-ba80-e9d0fc1327dc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:08.298025 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9f27c59d-4ca3-43e3-ba80-e9d0fc1327dc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:08.298491 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9f27c59d-4ca3-43e3-ba80-e9d0fc1327dc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:08.298913 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9f27c59d-4ca3-43e3-ba80-e9d0fc1327dc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:08.299586 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9f27c59d-4ca3-43e3-ba80-e9d0fc1327dc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:08.300436 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9f27c59d-4ca3-43e3-ba80-e9d0fc1327dc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:08.300782 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9f27c59d-4ca3-43e3-ba80-e9d0fc1327dc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:08.434471 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-9f27c59d-4ca3-43e3-ba80-e9d0fc1327dc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:08.437931 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=100 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:41:08.442214 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-9f27c59d-4ca3-43e3-ba80-e9d0fc1327dc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.155174 Aug 04 21:41:08.442778 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 76/142] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:08 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:09.001134 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-880d9063-79f2-429f-b07e-c545ecaf7360 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:09.001874 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-880d9063-79f2-429f-b07e-c545ecaf7360 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:09.007905 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-880d9063-79f2-429f-b07e-c545ecaf7360 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:09.011578 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-880d9063-79f2-429f-b07e-c545ecaf7360 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:09.011578 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-880d9063-79f2-429f-b07e-c545ecaf7360 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:09.011578 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-880d9063-79f2-429f-b07e-c545ecaf7360 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:09.011578 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-880d9063-79f2-429f-b07e-c545ecaf7360 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:09.012097 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-880d9063-79f2-429f-b07e-c545ecaf7360 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:09.141059 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2f0f813f-38c6-425e-8ad4-146943cfd649 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:09.141619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-2f0f813f-38c6-425e-8ad4-146943cfd649 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:09.148506 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f0f813f-38c6-425e-8ad4-146943cfd649 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:09.150023 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f0f813f-38c6-425e-8ad4-146943cfd649 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:09.150023 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f0f813f-38c6-425e-8ad4-146943cfd649 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:09.150236 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f0f813f-38c6-425e-8ad4-146943cfd649 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:09.151293 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f0f813f-38c6-425e-8ad4-146943cfd649 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:09.151862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f0f813f-38c6-425e-8ad4-146943cfd649 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:09.155007 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-880d9063-79f2-429f-b07e-c545ecaf7360 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:09.163177 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-880d9063-79f2-429f-b07e-c545ecaf7360 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:09.164662 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-880d9063-79f2-429f-b07e-c545ecaf7360 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:09.165799 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-880d9063-79f2-429f-b07e-c545ecaf7360 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.168882 Aug 04 21:41:09.167101 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 67/143] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:08 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:09.198769 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b1086263-6474-42df-8043-5059a3502575 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:09.199579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b1086263-6474-42df-8043-5059a3502575 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:09.205651 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b1086263-6474-42df-8043-5059a3502575 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:09.213895 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b1086263-6474-42df-8043-5059a3502575 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:09.213895 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b1086263-6474-42df-8043-5059a3502575 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:09.213895 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b1086263-6474-42df-8043-5059a3502575 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:09.213895 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b1086263-6474-42df-8043-5059a3502575 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:09.214934 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b1086263-6474-42df-8043-5059a3502575 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:09.318585 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2f0f813f-38c6-425e-8ad4-146943cfd649 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:09.326813 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2f0f813f-38c6-425e-8ad4-146943cfd649 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.189678 Aug 04 21:41:09.327473 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 77/144] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:09 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:09.358120 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b1086263-6474-42df-8043-5059a3502575 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:09.366074 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b1086263-6474-42df-8043-5059a3502575 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.171633 Aug 04 21:41:09.366516 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 68/145] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:09 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:09.468564 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-9a12ed5d-7d11-4773-85ff-d1c46c639a95 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:09.469167 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-9a12ed5d-7d11-4773-85ff-d1c46c639a95 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:09.474941 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a12ed5d-7d11-4773-85ff-d1c46c639a95 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:09.475421 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a12ed5d-7d11-4773-85ff-d1c46c639a95 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:09.475849 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a12ed5d-7d11-4773-85ff-d1c46c639a95 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:09.476537 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a12ed5d-7d11-4773-85ff-d1c46c639a95 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:09.476993 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a12ed5d-7d11-4773-85ff-d1c46c639a95 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:09.477406 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a12ed5d-7d11-4773-85ff-d1c46c639a95 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:09.628408 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-9a12ed5d-7d11-4773-85ff-d1c46c639a95 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:09.636908 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-9a12ed5d-7d11-4773-85ff-d1c46c639a95 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.172064 Aug 04 21:41:09.642704 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 78/146] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:09 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:10.189304 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ac3eff52-47be-4f44-a3ec-6e0e601bd94b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:10.189968 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ac3eff52-47be-4f44-a3ec-6e0e601bd94b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:10.195963 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ac3eff52-47be-4f44-a3ec-6e0e601bd94b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:10.196447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ac3eff52-47be-4f44-a3ec-6e0e601bd94b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:10.197035 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ac3eff52-47be-4f44-a3ec-6e0e601bd94b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:10.198459 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ac3eff52-47be-4f44-a3ec-6e0e601bd94b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:10.198943 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ac3eff52-47be-4f44-a3ec-6e0e601bd94b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:10.199776 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ac3eff52-47be-4f44-a3ec-6e0e601bd94b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:10.350496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-4449e2f8-2806-476e-a0c5-b807da544fe7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:10.357089 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-4449e2f8-2806-476e-a0c5-b807da544fe7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:10.361087 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4449e2f8-2806-476e-a0c5-b807da544fe7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:10.361578 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4449e2f8-2806-476e-a0c5-b807da544fe7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:10.362318 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4449e2f8-2806-476e-a0c5-b807da544fe7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:10.363808 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4449e2f8-2806-476e-a0c5-b807da544fe7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:10.364550 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4449e2f8-2806-476e-a0c5-b807da544fe7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:10.365155 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4449e2f8-2806-476e-a0c5-b807da544fe7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:10.379194 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ac3eff52-47be-4f44-a3ec-6e0e601bd94b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:10.392156 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ac3eff52-47be-4f44-a3ec-6e0e601bd94b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:10.394181 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ac3eff52-47be-4f44-a3ec-6e0e601bd94b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:10.396214 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ac3eff52-47be-4f44-a3ec-6e0e601bd94b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.210842 Aug 04 21:41:10.397340 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 69/147] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:10 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:10.403553 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-808475e4-aabb-45b1-b841-a850ca900848 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:10.404539 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-808475e4-aabb-45b1-b841-a850ca900848 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:10.413108 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-808475e4-aabb-45b1-b841-a850ca900848 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:10.413595 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-808475e4-aabb-45b1-b841-a850ca900848 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:10.414040 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-808475e4-aabb-45b1-b841-a850ca900848 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:10.414746 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-808475e4-aabb-45b1-b841-a850ca900848 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:10.415191 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-808475e4-aabb-45b1-b841-a850ca900848 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:10.415606 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-808475e4-aabb-45b1-b841-a850ca900848 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:10.534672 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4449e2f8-2806-476e-a0c5-b807da544fe7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:10.542784 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-4449e2f8-2806-476e-a0c5-b807da544fe7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.199736 Aug 04 21:41:10.543357 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 79/148] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:10 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:10.579537 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-808475e4-aabb-45b1-b841-a850ca900848 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:10.587271 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-808475e4-aabb-45b1-b841-a850ca900848 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.188485 Aug 04 21:41:10.587840 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 70/149] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:10 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:10.659155 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-0eee9ce0-49bf-425a-8125-ba53d726b075 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:10.659631 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-0eee9ce0-49bf-425a-8125-ba53d726b075 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:10.692857 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0eee9ce0-49bf-425a-8125-ba53d726b075 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:10.694369 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0eee9ce0-49bf-425a-8125-ba53d726b075 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:10.696706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0eee9ce0-49bf-425a-8125-ba53d726b075 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:10.701362 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0eee9ce0-49bf-425a-8125-ba53d726b075 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:10.701920 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0eee9ce0-49bf-425a-8125-ba53d726b075 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:10.702381 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0eee9ce0-49bf-425a-8125-ba53d726b075 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:10.843362 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-0eee9ce0-49bf-425a-8125-ba53d726b075 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:10.856660 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-0eee9ce0-49bf-425a-8125-ba53d726b075 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.200906 Aug 04 21:41:10.858294 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 80/150] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:10 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:11.419702 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a71300ac-f010-4735-b543-766a1e8815aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:11.420299 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-a71300ac-f010-4735-b543-766a1e8815aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:11.426144 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a71300ac-f010-4735-b543-766a1e8815aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:11.426615 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a71300ac-f010-4735-b543-766a1e8815aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:11.427109 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a71300ac-f010-4735-b543-766a1e8815aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:11.427763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a71300ac-f010-4735-b543-766a1e8815aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:11.428200 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a71300ac-f010-4735-b543-766a1e8815aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:11.428610 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a71300ac-f010-4735-b543-766a1e8815aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:11.560538 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-a71300ac-f010-4735-b543-766a1e8815aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:11.564482 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-27cec7bd-f8d5-4a60-8894-ddcfd9be873b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:11.570174 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-27cec7bd-f8d5-4a60-8894-ddcfd9be873b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:11.570299 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-a71300ac-f010-4735-b543-766a1e8815aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:11.570392 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-a71300ac-f010-4735-b543-766a1e8815aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:11.571499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-27cec7bd-f8d5-4a60-8894-ddcfd9be873b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:11.571914 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-a71300ac-f010-4735-b543-766a1e8815aa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.156744 Aug 04 21:41:11.572054 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-27cec7bd-f8d5-4a60-8894-ddcfd9be873b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:11.572954 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-27cec7bd-f8d5-4a60-8894-ddcfd9be873b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:11.573103 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 71/151] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:11 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:11.574196 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-27cec7bd-f8d5-4a60-8894-ddcfd9be873b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:11.574657 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-27cec7bd-f8d5-4a60-8894-ddcfd9be873b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:11.575081 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-27cec7bd-f8d5-4a60-8894-ddcfd9be873b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:11.608712 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-83a0e415-cbfe-4aba-9fda-52ce4416601e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:11.609320 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-83a0e415-cbfe-4aba-9fda-52ce4416601e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:11.615570 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-83a0e415-cbfe-4aba-9fda-52ce4416601e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:11.616046 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-83a0e415-cbfe-4aba-9fda-52ce4416601e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:11.616471 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-83a0e415-cbfe-4aba-9fda-52ce4416601e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:11.617410 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-83a0e415-cbfe-4aba-9fda-52ce4416601e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:11.617857 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-83a0e415-cbfe-4aba-9fda-52ce4416601e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:11.618306 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-83a0e415-cbfe-4aba-9fda-52ce4416601e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:11.717773 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-27cec7bd-f8d5-4a60-8894-ddcfd9be873b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:11.726210 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-27cec7bd-f8d5-4a60-8894-ddcfd9be873b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.165431 Aug 04 21:41:11.726786 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 81/152] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:11 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:11.758588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-83a0e415-cbfe-4aba-9fda-52ce4416601e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:11.767003 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-83a0e415-cbfe-4aba-9fda-52ce4416601e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.162021 Aug 04 21:41:11.768835 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 72/153] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:11 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:11.881768 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f880dd88-8ff4-44f7-abbd-1c471ea38cc3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:11.882375 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-f880dd88-8ff4-44f7-abbd-1c471ea38cc3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:11.889147 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f880dd88-8ff4-44f7-abbd-1c471ea38cc3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:11.889704 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f880dd88-8ff4-44f7-abbd-1c471ea38cc3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:11.890243 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f880dd88-8ff4-44f7-abbd-1c471ea38cc3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:11.890952 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f880dd88-8ff4-44f7-abbd-1c471ea38cc3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:11.891400 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f880dd88-8ff4-44f7-abbd-1c471ea38cc3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:11.891814 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f880dd88-8ff4-44f7-abbd-1c471ea38cc3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:12.024554 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f880dd88-8ff4-44f7-abbd-1c471ea38cc3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:12.031892 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f880dd88-8ff4-44f7-abbd-1c471ea38cc3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.153895 Aug 04 21:41:12.032550 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 82/154] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:11 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:12.594506 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-03ce875b-58de-4614-bea5-c2107ec89460 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:12.595126 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-03ce875b-58de-4614-bea5-c2107ec89460 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:12.601230 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03ce875b-58de-4614-bea5-c2107ec89460 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:12.601707 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03ce875b-58de-4614-bea5-c2107ec89460 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:12.602166 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03ce875b-58de-4614-bea5-c2107ec89460 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:12.602846 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03ce875b-58de-4614-bea5-c2107ec89460 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:12.603307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03ce875b-58de-4614-bea5-c2107ec89460 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:12.603834 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03ce875b-58de-4614-bea5-c2107ec89460 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:12.737597 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-03ce875b-58de-4614-bea5-c2107ec89460 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:12.746585 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-03ce875b-58de-4614-bea5-c2107ec89460 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:12.748222 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-03ce875b-58de-4614-bea5-c2107ec89460 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:12.749074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-74bcd6a6-fbfa-41f5-91a0-dace00a97686 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:12.749516 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-03ce875b-58de-4614-bea5-c2107ec89460 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.158880 Aug 04 21:41:12.749683 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-74bcd6a6-fbfa-41f5-91a0-dace00a97686 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:12.750205 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 73/155] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:12 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:12.756456 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-74bcd6a6-fbfa-41f5-91a0-dace00a97686 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:12.756935 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-74bcd6a6-fbfa-41f5-91a0-dace00a97686 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:12.757362 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-74bcd6a6-fbfa-41f5-91a0-dace00a97686 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:12.758235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-74bcd6a6-fbfa-41f5-91a0-dace00a97686 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:12.758726 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-74bcd6a6-fbfa-41f5-91a0-dace00a97686 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:12.759139 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-74bcd6a6-fbfa-41f5-91a0-dace00a97686 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:12.788081 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-3b4f04ba-9a39-4ba8-977b-2ff94b46b2ac tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:12.788788 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-3b4f04ba-9a39-4ba8-977b-2ff94b46b2ac tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:12.794969 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3b4f04ba-9a39-4ba8-977b-2ff94b46b2ac tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:12.795457 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3b4f04ba-9a39-4ba8-977b-2ff94b46b2ac tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:12.795887 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3b4f04ba-9a39-4ba8-977b-2ff94b46b2ac tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:12.796579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3b4f04ba-9a39-4ba8-977b-2ff94b46b2ac tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:12.797384 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3b4f04ba-9a39-4ba8-977b-2ff94b46b2ac tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:12.797809 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3b4f04ba-9a39-4ba8-977b-2ff94b46b2ac tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:12.908030 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-74bcd6a6-fbfa-41f5-91a0-dace00a97686 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:12.916905 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-74bcd6a6-fbfa-41f5-91a0-dace00a97686 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.171719 Aug 04 21:41:12.917848 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 83/156] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:12 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:12.935436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-3b4f04ba-9a39-4ba8-977b-2ff94b46b2ac tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:12.938862 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=100 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:41:12.943116 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-3b4f04ba-9a39-4ba8-977b-2ff94b46b2ac tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.158843 Aug 04 21:41:12.943663 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 74/157] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:12 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:13.052556 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-7bc4c8c4-1054-450c-b64c-171325f7142e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:13.053168 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-7bc4c8c4-1054-450c-b64c-171325f7142e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:13.058977 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7bc4c8c4-1054-450c-b64c-171325f7142e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:13.059451 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7bc4c8c4-1054-450c-b64c-171325f7142e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:13.059874 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7bc4c8c4-1054-450c-b64c-171325f7142e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:13.060550 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7bc4c8c4-1054-450c-b64c-171325f7142e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:13.060991 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7bc4c8c4-1054-450c-b64c-171325f7142e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:13.061405 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7bc4c8c4-1054-450c-b64c-171325f7142e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:13.196232 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-7bc4c8c4-1054-450c-b64c-171325f7142e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:13.204478 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-7bc4c8c4-1054-450c-b64c-171325f7142e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.155708 Aug 04 21:41:13.205038 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 84/158] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:13 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:13.772588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-0388f767-8075-4cfd-b82e-858bce7bceb9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:13.773188 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-0388f767-8075-4cfd-b82e-858bce7bceb9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:13.779743 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0388f767-8075-4cfd-b82e-858bce7bceb9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:13.780219 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0388f767-8075-4cfd-b82e-858bce7bceb9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:13.780650 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0388f767-8075-4cfd-b82e-858bce7bceb9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:13.781382 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0388f767-8075-4cfd-b82e-858bce7bceb9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:13.781834 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0388f767-8075-4cfd-b82e-858bce7bceb9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:13.782273 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0388f767-8075-4cfd-b82e-858bce7bceb9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:13.917418 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0388f767-8075-4cfd-b82e-858bce7bceb9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:13.925637 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0388f767-8075-4cfd-b82e-858bce7bceb9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:13.927256 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0388f767-8075-4cfd-b82e-858bce7bceb9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:13.928346 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-0388f767-8075-4cfd-b82e-858bce7bceb9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.160067 Aug 04 21:41:13.928904 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 75/159] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:13 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:13.937365 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-6363fe6a-db3c-4df8-826c-3e950b0f0cca tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:13.940562 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-6363fe6a-db3c-4df8-826c-3e950b0f0cca tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:13.943948 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6363fe6a-db3c-4df8-826c-3e950b0f0cca tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:13.944496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6363fe6a-db3c-4df8-826c-3e950b0f0cca tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:13.944925 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6363fe6a-db3c-4df8-826c-3e950b0f0cca tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:13.945594 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6363fe6a-db3c-4df8-826c-3e950b0f0cca tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:13.946059 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6363fe6a-db3c-4df8-826c-3e950b0f0cca tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:13.946477 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6363fe6a-db3c-4df8-826c-3e950b0f0cca tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:13.965870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-67439781-bd35-4d5f-a4e5-abde7aa9e632 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:13.966508 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-67439781-bd35-4d5f-a4e5-abde7aa9e632 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:13.973341 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-67439781-bd35-4d5f-a4e5-abde7aa9e632 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:13.974042 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-67439781-bd35-4d5f-a4e5-abde7aa9e632 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:13.974652 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-67439781-bd35-4d5f-a4e5-abde7aa9e632 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:13.975349 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-67439781-bd35-4d5f-a4e5-abde7aa9e632 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:13.975792 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-67439781-bd35-4d5f-a4e5-abde7aa9e632 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:13.976354 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-67439781-bd35-4d5f-a4e5-abde7aa9e632 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:14.099364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6363fe6a-db3c-4df8-826c-3e950b0f0cca tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:14.108262 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-6363fe6a-db3c-4df8-826c-3e950b0f0cca tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.174761 Aug 04 21:41:14.112749 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 85/160] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:13 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:14.118605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-67439781-bd35-4d5f-a4e5-abde7aa9e632 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:14.130351 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-67439781-bd35-4d5f-a4e5-abde7aa9e632 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.169712 Aug 04 21:41:14.130997 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 76/161] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:13 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:14.225714 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-348672c6-e8ae-4481-bb96-a968b6f69cc0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:14.226260 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-348672c6-e8ae-4481-bb96-a968b6f69cc0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:14.232686 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-348672c6-e8ae-4481-bb96-a968b6f69cc0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:14.233156 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-348672c6-e8ae-4481-bb96-a968b6f69cc0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:14.233583 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-348672c6-e8ae-4481-bb96-a968b6f69cc0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:14.234289 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-348672c6-e8ae-4481-bb96-a968b6f69cc0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:14.234730 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-348672c6-e8ae-4481-bb96-a968b6f69cc0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:14.239194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-348672c6-e8ae-4481-bb96-a968b6f69cc0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:14.392350 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-348672c6-e8ae-4481-bb96-a968b6f69cc0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:14.400066 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-348672c6-e8ae-4481-bb96-a968b6f69cc0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.178239 Aug 04 21:41:14.400673 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 86/162] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:14 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:14.952593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-950963f4-c51d-4f3d-9bc3-41129353fd52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:14.953272 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-950963f4-c51d-4f3d-9bc3-41129353fd52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:14.959370 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-950963f4-c51d-4f3d-9bc3-41129353fd52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:14.960583 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-950963f4-c51d-4f3d-9bc3-41129353fd52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:14.960583 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-950963f4-c51d-4f3d-9bc3-41129353fd52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:14.960957 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-950963f4-c51d-4f3d-9bc3-41129353fd52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:14.961411 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-950963f4-c51d-4f3d-9bc3-41129353fd52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:14.961825 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-950963f4-c51d-4f3d-9bc3-41129353fd52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:15.130324 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-950963f4-c51d-4f3d-9bc3-41129353fd52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:15.132598 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-51b938f7-7671-4f3a-9f07-7486f3483e54 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:15.133308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-51b938f7-7671-4f3a-9f07-7486f3483e54 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:15.138788 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=100 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:41:15.139627 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-950963f4-c51d-4f3d-9bc3-41129353fd52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:15.146665 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-51b938f7-7671-4f3a-9f07-7486f3483e54 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:15.146665 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-51b938f7-7671-4f3a-9f07-7486f3483e54 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:15.146865 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-950963f4-c51d-4f3d-9bc3-41129353fd52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:15.146950 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-51b938f7-7671-4f3a-9f07-7486f3483e54 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:15.146950 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-51b938f7-7671-4f3a-9f07-7486f3483e54 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:15.147097 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-950963f4-c51d-4f3d-9bc3-41129353fd52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.194457 Aug 04 21:41:15.147166 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-51b938f7-7671-4f3a-9f07-7486f3483e54 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:15.147241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 77/163] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:14 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:15.147311 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-51b938f7-7671-4f3a-9f07-7486f3483e54 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:15.154675 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6d57185e-b7ec-412e-ba96-f4f6950d2225 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:15.155508 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-6d57185e-b7ec-412e-ba96-f4f6950d2225 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:15.167669 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6d57185e-b7ec-412e-ba96-f4f6950d2225 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:15.168476 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6d57185e-b7ec-412e-ba96-f4f6950d2225 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:15.168902 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6d57185e-b7ec-412e-ba96-f4f6950d2225 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:15.169774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6d57185e-b7ec-412e-ba96-f4f6950d2225 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:15.170443 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6d57185e-b7ec-412e-ba96-f4f6950d2225 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:15.171010 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6d57185e-b7ec-412e-ba96-f4f6950d2225 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:15.282158 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-51b938f7-7671-4f3a-9f07-7486f3483e54 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:15.289711 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-51b938f7-7671-4f3a-9f07-7486f3483e54 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.161080 Aug 04 21:41:15.290349 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 87/164] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:15 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:15.357526 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6d57185e-b7ec-412e-ba96-f4f6950d2225 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:15.365225 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-6d57185e-b7ec-412e-ba96-f4f6950d2225 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.215868 Aug 04 21:41:15.365789 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 78/165] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:15 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:15.421586 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-67e0c0e9-a503-452a-8780-86867ddd4982 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:15.422239 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-67e0c0e9-a503-452a-8780-86867ddd4982 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:15.437692 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-67e0c0e9-a503-452a-8780-86867ddd4982 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:15.437692 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-67e0c0e9-a503-452a-8780-86867ddd4982 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:15.437692 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-67e0c0e9-a503-452a-8780-86867ddd4982 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:15.437692 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-67e0c0e9-a503-452a-8780-86867ddd4982 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:15.438064 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-67e0c0e9-a503-452a-8780-86867ddd4982 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:15.438064 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-67e0c0e9-a503-452a-8780-86867ddd4982 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:15.596420 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-67e0c0e9-a503-452a-8780-86867ddd4982 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:15.607225 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-67e0c0e9-a503-452a-8780-86867ddd4982 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.190279 Aug 04 21:41:15.608267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 88/166] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:15 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:16.164947 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-45105ba3-f02c-483d-b782-057ce488daec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:16.165552 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-45105ba3-f02c-483d-b782-057ce488daec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:16.172542 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-45105ba3-f02c-483d-b782-057ce488daec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:16.172902 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-45105ba3-f02c-483d-b782-057ce488daec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:16.173349 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-45105ba3-f02c-483d-b782-057ce488daec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:16.174055 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-45105ba3-f02c-483d-b782-057ce488daec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:16.174499 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-45105ba3-f02c-483d-b782-057ce488daec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:16.174910 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-45105ba3-f02c-483d-b782-057ce488daec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:16.309151 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-45105ba3-f02c-483d-b782-057ce488daec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:16.312007 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-fa8081cd-802c-42f8-8dc6-34ec87ab3731 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:16.312613 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-fa8081cd-802c-42f8-8dc6-34ec87ab3731 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:16.318395 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-45105ba3-f02c-483d-b782-057ce488daec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:16.318779 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fa8081cd-802c-42f8-8dc6-34ec87ab3731 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:16.319023 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fa8081cd-802c-42f8-8dc6-34ec87ab3731 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:16.319458 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fa8081cd-802c-42f8-8dc6-34ec87ab3731 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:16.320144 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fa8081cd-802c-42f8-8dc6-34ec87ab3731 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:16.320555 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-45105ba3-f02c-483d-b782-057ce488daec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:16.320932 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fa8081cd-802c-42f8-8dc6-34ec87ab3731 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:16.321354 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fa8081cd-802c-42f8-8dc6-34ec87ab3731 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:16.321908 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-45105ba3-f02c-483d-b782-057ce488daec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.160858 Aug 04 21:41:16.322544 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 79/167] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:16 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:16.387028 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e1c24d3b-47d3-4e40-8f57-214ab95a6aac tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:16.392960 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e1c24d3b-47d3-4e40-8f57-214ab95a6aac tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:16.398269 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e1c24d3b-47d3-4e40-8f57-214ab95a6aac tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:16.398769 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e1c24d3b-47d3-4e40-8f57-214ab95a6aac tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:16.400082 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e1c24d3b-47d3-4e40-8f57-214ab95a6aac tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:16.401491 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e1c24d3b-47d3-4e40-8f57-214ab95a6aac tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:16.402115 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e1c24d3b-47d3-4e40-8f57-214ab95a6aac tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:16.402800 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e1c24d3b-47d3-4e40-8f57-214ab95a6aac tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:16.480335 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-fa8081cd-802c-42f8-8dc6-34ec87ab3731 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:16.482311 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-fa8081cd-802c-42f8-8dc6-34ec87ab3731 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.174755 Aug 04 21:41:16.483375 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 89/168] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:16 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:16.580558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e1c24d3b-47d3-4e40-8f57-214ab95a6aac tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:16.588890 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e1c24d3b-47d3-4e40-8f57-214ab95a6aac tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.205134 Aug 04 21:41:16.589528 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 80/169] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:16 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:16.627847 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d0e704ab-63b3-43a1-be86-9e4fc18ff50e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:16.628501 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-d0e704ab-63b3-43a1-be86-9e4fc18ff50e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:16.634304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d0e704ab-63b3-43a1-be86-9e4fc18ff50e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:16.634783 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d0e704ab-63b3-43a1-be86-9e4fc18ff50e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:16.635676 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d0e704ab-63b3-43a1-be86-9e4fc18ff50e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:16.636568 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d0e704ab-63b3-43a1-be86-9e4fc18ff50e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:16.637021 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d0e704ab-63b3-43a1-be86-9e4fc18ff50e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:16.637464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d0e704ab-63b3-43a1-be86-9e4fc18ff50e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:16.782316 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d0e704ab-63b3-43a1-be86-9e4fc18ff50e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:16.787398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d0e704ab-63b3-43a1-be86-9e4fc18ff50e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.163499 Aug 04 21:41:16.787994 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 90/170] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:16 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:17.345930 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-743e1f75-4f4e-4b78-9c06-44fef80f4a7b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:17.347103 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-743e1f75-4f4e-4b78-9c06-44fef80f4a7b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:17.353576 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-743e1f75-4f4e-4b78-9c06-44fef80f4a7b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:17.354714 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-743e1f75-4f4e-4b78-9c06-44fef80f4a7b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:17.355768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-743e1f75-4f4e-4b78-9c06-44fef80f4a7b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:17.356422 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-743e1f75-4f4e-4b78-9c06-44fef80f4a7b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:17.356879 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-743e1f75-4f4e-4b78-9c06-44fef80f4a7b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:17.357304 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-743e1f75-4f4e-4b78-9c06-44fef80f4a7b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:17.504825 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-743e1f75-4f4e-4b78-9c06-44fef80f4a7b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:17.507655 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ce79f4f9-c848-4ffa-bf46-a5883a110eeb tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:17.512437 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ce79f4f9-c848-4ffa-bf46-a5883a110eeb tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:17.528773 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ce79f4f9-c848-4ffa-bf46-a5883a110eeb tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:17.529238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ce79f4f9-c848-4ffa-bf46-a5883a110eeb tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:17.529687 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ce79f4f9-c848-4ffa-bf46-a5883a110eeb tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:17.530427 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ce79f4f9-c848-4ffa-bf46-a5883a110eeb tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:17.530881 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ce79f4f9-c848-4ffa-bf46-a5883a110eeb tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:17.531932 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-743e1f75-4f4e-4b78-9c06-44fef80f4a7b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:17.533465 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-743e1f75-4f4e-4b78-9c06-44fef80f4a7b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:17.534668 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-743e1f75-4f4e-4b78-9c06-44fef80f4a7b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.193071 Aug 04 21:41:17.539155 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 81/171] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:17 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:17.539440 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ce79f4f9-c848-4ffa-bf46-a5883a110eeb tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:17.610710 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d360c34d-3b22-4d8b-8343-8528f6f851da tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:17.611636 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d360c34d-3b22-4d8b-8343-8528f6f851da tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:17.617813 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d360c34d-3b22-4d8b-8343-8528f6f851da tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:17.618350 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d360c34d-3b22-4d8b-8343-8528f6f851da tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:17.618783 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d360c34d-3b22-4d8b-8343-8528f6f851da tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:17.619517 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d360c34d-3b22-4d8b-8343-8528f6f851da tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:17.620201 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d360c34d-3b22-4d8b-8343-8528f6f851da tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:17.620636 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d360c34d-3b22-4d8b-8343-8528f6f851da tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:17.689176 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ce79f4f9-c848-4ffa-bf46-a5883a110eeb tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:17.704904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ce79f4f9-c848-4ffa-bf46-a5883a110eeb tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.204913 Aug 04 21:41:17.720293 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 91/172] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:17 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:17.762181 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d360c34d-3b22-4d8b-8343-8528f6f851da tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:17.770061 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d360c34d-3b22-4d8b-8343-8528f6f851da tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.164016 Aug 04 21:41:17.777579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 82/173] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:17 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:17.810311 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-8a140b81-36d2-43b4-a4d9-d5107b21e17d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:17.811143 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-8a140b81-36d2-43b4-a4d9-d5107b21e17d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:17.817008 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8a140b81-36d2-43b4-a4d9-d5107b21e17d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:17.817422 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8a140b81-36d2-43b4-a4d9-d5107b21e17d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:17.818113 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8a140b81-36d2-43b4-a4d9-d5107b21e17d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:17.818814 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8a140b81-36d2-43b4-a4d9-d5107b21e17d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:17.819271 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8a140b81-36d2-43b4-a4d9-d5107b21e17d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:17.819819 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8a140b81-36d2-43b4-a4d9-d5107b21e17d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:17.978807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8a140b81-36d2-43b4-a4d9-d5107b21e17d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:17.990042 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-8a140b81-36d2-43b4-a4d9-d5107b21e17d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.184555 Aug 04 21:41:17.991022 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 92/174] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:17 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:18.561061 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-7166153b-1801-4bae-a758-8777e12025a0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:18.561668 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7166153b-1801-4bae-a758-8777e12025a0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:18.568212 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7166153b-1801-4bae-a758-8777e12025a0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:18.568957 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7166153b-1801-4bae-a758-8777e12025a0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:18.569600 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7166153b-1801-4bae-a758-8777e12025a0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:18.571563 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7166153b-1801-4bae-a758-8777e12025a0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:18.572032 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7166153b-1801-4bae-a758-8777e12025a0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:18.572462 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7166153b-1801-4bae-a758-8777e12025a0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:18.731723 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-8098b0e9-bc90-4fc5-98cb-83904a4e3279 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:18.732452 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-8098b0e9-bc90-4fc5-98cb-83904a4e3279 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:18.739813 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8098b0e9-bc90-4fc5-98cb-83904a4e3279 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:18.740499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8098b0e9-bc90-4fc5-98cb-83904a4e3279 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:18.740763 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8098b0e9-bc90-4fc5-98cb-83904a4e3279 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:18.741379 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8098b0e9-bc90-4fc5-98cb-83904a4e3279 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:18.741822 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8098b0e9-bc90-4fc5-98cb-83904a4e3279 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:18.742524 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8098b0e9-bc90-4fc5-98cb-83904a4e3279 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:18.767209 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=100 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:41:18.993165 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7166153b-1801-4bae-a758-8777e12025a0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:19.006973 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7166153b-1801-4bae-a758-8777e12025a0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:19.008692 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7166153b-1801-4bae-a758-8777e12025a0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:19.009842 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-7166153b-1801-4bae-a758-8777e12025a0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.453542 Aug 04 21:41:19.035473 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 83/175] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:18 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:19.042099 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-1ce22d8e-7a33-4dc4-97d3-6f0e8d65817d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:19.042716 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-1ce22d8e-7a33-4dc4-97d3-6f0e8d65817d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:19.055835 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1ce22d8e-7a33-4dc4-97d3-6f0e8d65817d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:19.056422 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1ce22d8e-7a33-4dc4-97d3-6f0e8d65817d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:19.056840 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1ce22d8e-7a33-4dc4-97d3-6f0e8d65817d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:19.058280 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1ce22d8e-7a33-4dc4-97d3-6f0e8d65817d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:19.058786 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1ce22d8e-7a33-4dc4-97d3-6f0e8d65817d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:19.059207 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1ce22d8e-7a33-4dc4-97d3-6f0e8d65817d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:19.135754 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8098b0e9-bc90-4fc5-98cb-83904a4e3279 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:19.143037 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-8098b0e9-bc90-4fc5-98cb-83904a4e3279 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.415148 Aug 04 21:41:19.143826 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 93/176] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:18 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:19.148195 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-6528c7d9-8481-4bd7-8697-ed76a800df89 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:19.148833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-6528c7d9-8481-4bd7-8697-ed76a800df89 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:19.161204 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6528c7d9-8481-4bd7-8697-ed76a800df89 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:19.161704 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6528c7d9-8481-4bd7-8697-ed76a800df89 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:19.162196 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6528c7d9-8481-4bd7-8697-ed76a800df89 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:19.171576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6528c7d9-8481-4bd7-8697-ed76a800df89 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:19.172738 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6528c7d9-8481-4bd7-8697-ed76a800df89 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:19.173531 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6528c7d9-8481-4bd7-8697-ed76a800df89 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:19.390815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1ce22d8e-7a33-4dc4-97d3-6f0e8d65817d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:19.400458 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-1ce22d8e-7a33-4dc4-97d3-6f0e8d65817d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.363393 Aug 04 21:41:19.403086 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 84/177] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:19 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:19.496595 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-b292a4d8-149d-4f38-81eb-198284ec45cc req-130b6d2d-42d2-459f-8e2f-14deef8ed6ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b3cb09-2341-45b6-85aa-26706dd17e65", "name": "network-vif-plugged", "status": "completed", "tag": "d31cf969-7aa9-4aed-8a90-7b1398f0f788"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:41:19.502531 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6528c7d9-8481-4bd7-8697-ed76a800df89 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:19.507594 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-b292a4d8-149d-4f38-81eb-198284ec45cc req-130b6d2d-42d2-459f-8e2f-14deef8ed6ad service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:19.508076 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-b292a4d8-149d-4f38-81eb-198284ec45cc req-130b6d2d-42d2-459f-8e2f-14deef8ed6ad service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:19.508505 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-b292a4d8-149d-4f38-81eb-198284ec45cc req-130b6d2d-42d2-459f-8e2f-14deef8ed6ad service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:19.510246 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-6528c7d9-8481-4bd7-8697-ed76a800df89 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.365540 Aug 04 21:41:19.511752 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 94/178] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:19 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:19.524874 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-b292a4d8-149d-4f38-81eb-198284ec45cc req-130b6d2d-42d2-459f-8e2f-14deef8ed6ad service nova] Creating event network-vif-plugged:d31cf969-7aa9-4aed-8a90-7b1398f0f788 for instance 80b3cb09-2341-45b6-85aa-26706dd17e65 on hv-cinder-85220 Aug 04 21:41:19.529303 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-b292a4d8-149d-4f38-81eb-198284ec45cc req-130b6d2d-42d2-459f-8e2f-14deef8ed6ad service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124294 Aug 04 21:41:19.530121 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 85/179] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:41:20.034094 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a7c42ad2-d99a-4c20-a038-da8a86f4e12e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:20.035525 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a7c42ad2-d99a-4c20-a038-da8a86f4e12e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:20.042345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a7c42ad2-d99a-4c20-a038-da8a86f4e12e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:20.042922 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a7c42ad2-d99a-4c20-a038-da8a86f4e12e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:20.043354 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a7c42ad2-d99a-4c20-a038-da8a86f4e12e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:20.044054 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a7c42ad2-d99a-4c20-a038-da8a86f4e12e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:20.044498 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a7c42ad2-d99a-4c20-a038-da8a86f4e12e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:20.044918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a7c42ad2-d99a-4c20-a038-da8a86f4e12e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:20.165386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-342e65a2-8a35-4227-8405-99d5a44c9a5a tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:20.167051 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-342e65a2-8a35-4227-8405-99d5a44c9a5a tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:20.173463 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-342e65a2-8a35-4227-8405-99d5a44c9a5a tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:20.174197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-342e65a2-8a35-4227-8405-99d5a44c9a5a tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:20.174717 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-342e65a2-8a35-4227-8405-99d5a44c9a5a tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:20.175640 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-342e65a2-8a35-4227-8405-99d5a44c9a5a tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:20.176158 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-342e65a2-8a35-4227-8405-99d5a44c9a5a tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:20.176649 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-342e65a2-8a35-4227-8405-99d5a44c9a5a tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:20.181748 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a7c42ad2-d99a-4c20-a038-da8a86f4e12e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:20.202897 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a7c42ad2-d99a-4c20-a038-da8a86f4e12e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:20.202897 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a7c42ad2-d99a-4c20-a038-da8a86f4e12e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:20.202897 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a7c42ad2-d99a-4c20-a038-da8a86f4e12e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.165361 Aug 04 21:41:20.206157 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 95/180] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:20 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:20.321051 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-342e65a2-8a35-4227-8405-99d5a44c9a5a tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:20.330685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-342e65a2-8a35-4227-8405-99d5a44c9a5a tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.170526 Aug 04 21:41:20.331439 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 86/181] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:20 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:20.425176 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d7d84742-cc71-47c1-9596-8e833ed1a982 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:20.426520 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-d7d84742-cc71-47c1-9596-8e833ed1a982 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:20.437418 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d7d84742-cc71-47c1-9596-8e833ed1a982 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:20.437909 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d7d84742-cc71-47c1-9596-8e833ed1a982 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:20.438372 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d7d84742-cc71-47c1-9596-8e833ed1a982 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:20.439096 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d7d84742-cc71-47c1-9596-8e833ed1a982 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:20.439544 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d7d84742-cc71-47c1-9596-8e833ed1a982 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:20.439972 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d7d84742-cc71-47c1-9596-8e833ed1a982 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:20.540486 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2d5e7749-c77f-40a1-86bd-2cbf0004f61c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:20.541416 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2d5e7749-c77f-40a1-86bd-2cbf0004f61c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:20.547959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2d5e7749-c77f-40a1-86bd-2cbf0004f61c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:20.550026 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2d5e7749-c77f-40a1-86bd-2cbf0004f61c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:20.550026 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2d5e7749-c77f-40a1-86bd-2cbf0004f61c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:20.550026 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2d5e7749-c77f-40a1-86bd-2cbf0004f61c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:20.550600 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2d5e7749-c77f-40a1-86bd-2cbf0004f61c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:20.551028 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2d5e7749-c77f-40a1-86bd-2cbf0004f61c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:20.582793 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d7d84742-cc71-47c1-9596-8e833ed1a982 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:20.590813 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d7d84742-cc71-47c1-9596-8e833ed1a982 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.170633 Aug 04 21:41:20.591393 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 96/182] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:20 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:20.730449 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2d5e7749-c77f-40a1-86bd-2cbf0004f61c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:20.740303 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2d5e7749-c77f-40a1-86bd-2cbf0004f61c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.211125 Aug 04 21:41:20.741145 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 87/183] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:20 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:21.220094 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b249306d-1e8b-44b5-8abd-db52fed75085 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:21.220672 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b249306d-1e8b-44b5-8abd-db52fed75085 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:21.227186 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b249306d-1e8b-44b5-8abd-db52fed75085 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:21.227606 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b249306d-1e8b-44b5-8abd-db52fed75085 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:21.228033 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b249306d-1e8b-44b5-8abd-db52fed75085 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:21.228717 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b249306d-1e8b-44b5-8abd-db52fed75085 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:21.229671 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b249306d-1e8b-44b5-8abd-db52fed75085 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:21.230113 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b249306d-1e8b-44b5-8abd-db52fed75085 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:21.358162 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-afc25202-2c33-4d27-84b3-8f5b43177a92 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:21.358162 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-afc25202-2c33-4d27-84b3-8f5b43177a92 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:21.363982 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-afc25202-2c33-4d27-84b3-8f5b43177a92 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:21.365155 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-afc25202-2c33-4d27-84b3-8f5b43177a92 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:21.365155 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-afc25202-2c33-4d27-84b3-8f5b43177a92 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:21.365616 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-afc25202-2c33-4d27-84b3-8f5b43177a92 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:21.366294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-afc25202-2c33-4d27-84b3-8f5b43177a92 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:21.367069 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-afc25202-2c33-4d27-84b3-8f5b43177a92 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:21.423598 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b249306d-1e8b-44b5-8abd-db52fed75085 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:21.435496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b249306d-1e8b-44b5-8abd-db52fed75085 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:21.439379 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b249306d-1e8b-44b5-8abd-db52fed75085 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:21.440710 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b249306d-1e8b-44b5-8abd-db52fed75085 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.224568 Aug 04 21:41:21.442202 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 97/184] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:21 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:21.537195 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-afc25202-2c33-4d27-84b3-8f5b43177a92 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:21.544650 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-afc25202-2c33-4d27-84b3-8f5b43177a92 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.193188 Aug 04 21:41:21.545232 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 88/185] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:21 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:21.611144 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a009c1f2-1ff6-4d78-b70e-51f0fec6c7a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:21.611739 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a009c1f2-1ff6-4d78-b70e-51f0fec6c7a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:21.623025 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a009c1f2-1ff6-4d78-b70e-51f0fec6c7a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:21.623025 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a009c1f2-1ff6-4d78-b70e-51f0fec6c7a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:21.623025 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a009c1f2-1ff6-4d78-b70e-51f0fec6c7a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:21.623025 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a009c1f2-1ff6-4d78-b70e-51f0fec6c7a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:21.623317 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a009c1f2-1ff6-4d78-b70e-51f0fec6c7a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:21.623317 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a009c1f2-1ff6-4d78-b70e-51f0fec6c7a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:21.761589 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d26de1da-a517-456c-9206-1da2a93ffe4f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:21.762291 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d26de1da-a517-456c-9206-1da2a93ffe4f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:21.768375 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d26de1da-a517-456c-9206-1da2a93ffe4f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:21.773342 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d26de1da-a517-456c-9206-1da2a93ffe4f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:21.773342 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d26de1da-a517-456c-9206-1da2a93ffe4f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:21.773342 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d26de1da-a517-456c-9206-1da2a93ffe4f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:21.773342 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d26de1da-a517-456c-9206-1da2a93ffe4f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:21.773776 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d26de1da-a517-456c-9206-1da2a93ffe4f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:21.779216 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a009c1f2-1ff6-4d78-b70e-51f0fec6c7a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:21.789522 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a009c1f2-1ff6-4d78-b70e-51f0fec6c7a0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.182277 Aug 04 21:41:21.802242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 98/186] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:21 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:22.113214 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d26de1da-a517-456c-9206-1da2a93ffe4f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:22.121887 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d26de1da-a517-456c-9206-1da2a93ffe4f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.364911 Aug 04 21:41:22.122776 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 89/187] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:21 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:22.465288 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-8e4575a3-2884-4952-9dc9-78d214a48c55 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:22.465887 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-8e4575a3-2884-4952-9dc9-78d214a48c55 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:22.472027 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8e4575a3-2884-4952-9dc9-78d214a48c55 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:22.472851 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8e4575a3-2884-4952-9dc9-78d214a48c55 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:22.473485 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8e4575a3-2884-4952-9dc9-78d214a48c55 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:22.474403 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8e4575a3-2884-4952-9dc9-78d214a48c55 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:22.478538 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8e4575a3-2884-4952-9dc9-78d214a48c55 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:22.478538 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8e4575a3-2884-4952-9dc9-78d214a48c55 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:22.566302 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-42021cf2-5de3-4c31-b748-364e56af80ad tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:22.566938 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-42021cf2-5de3-4c31-b748-364e56af80ad tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:22.570512 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=100 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:41:22.575433 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-42021cf2-5de3-4c31-b748-364e56af80ad tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:22.575930 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-42021cf2-5de3-4c31-b748-364e56af80ad tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:22.576367 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-42021cf2-5de3-4c31-b748-364e56af80ad tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:22.577090 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-42021cf2-5de3-4c31-b748-364e56af80ad tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:22.577540 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-42021cf2-5de3-4c31-b748-364e56af80ad tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:22.577973 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-42021cf2-5de3-4c31-b748-364e56af80ad tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:22.755630 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-42021cf2-5de3-4c31-b748-364e56af80ad tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:22.768490 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-42021cf2-5de3-4c31-b748-364e56af80ad tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.204717 Aug 04 21:41:22.769400 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 90/188] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:22 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:22.813473 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b6942dba-e3d5-4c57-8b25-f638af12299b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:22.817685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b6942dba-e3d5-4c57-8b25-f638af12299b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:22.826862 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b6942dba-e3d5-4c57-8b25-f638af12299b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:22.827611 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b6942dba-e3d5-4c57-8b25-f638af12299b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:22.828219 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b6942dba-e3d5-4c57-8b25-f638af12299b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:22.829077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b6942dba-e3d5-4c57-8b25-f638af12299b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:22.829803 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b6942dba-e3d5-4c57-8b25-f638af12299b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:22.831038 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b6942dba-e3d5-4c57-8b25-f638af12299b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:23.068826 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8e4575a3-2884-4952-9dc9-78d214a48c55 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:23.082215 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8e4575a3-2884-4952-9dc9-78d214a48c55 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:23.083987 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8e4575a3-2884-4952-9dc9-78d214a48c55 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:23.085530 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-8e4575a3-2884-4952-9dc9-78d214a48c55 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.624479 Aug 04 21:41:23.086594 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 99/189] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:22 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:23.093507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-9fda477b-35f7-43c9-8a27-77771f8d2ed2 req-63d7ec3f-a376-4453-b11d-8eb9fbc4a767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9770e069-e3a5-4f2e-95a2-8308c2580ec7", "name": "network-vif-plugged", "status": "completed", "tag": "a31501ea-6fef-42f4-866e-93e03aeb08b1"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:41:23.102409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b6942dba-e3d5-4c57-8b25-f638af12299b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:23.103902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-9fda477b-35f7-43c9-8a27-77771f8d2ed2 req-63d7ec3f-a376-4453-b11d-8eb9fbc4a767 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:23.104992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-9fda477b-35f7-43c9-8a27-77771f8d2ed2 req-63d7ec3f-a376-4453-b11d-8eb9fbc4a767 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:23.105804 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-9fda477b-35f7-43c9-8a27-77771f8d2ed2 req-63d7ec3f-a376-4453-b11d-8eb9fbc4a767 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:23.110506 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b6942dba-e3d5-4c57-8b25-f638af12299b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.301194 Aug 04 21:41:23.118484 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-9fda477b-35f7-43c9-8a27-77771f8d2ed2 req-63d7ec3f-a376-4453-b11d-8eb9fbc4a767 service nova] Creating event network-vif-plugged:a31501ea-6fef-42f4-866e-93e03aeb08b1 for instance 9770e069-e3a5-4f2e-95a2-8308c2580ec7 on hv-cinder-85220 Aug 04 21:41:23.126337 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-9fda477b-35f7-43c9-8a27-77771f8d2ed2 req-63d7ec3f-a376-4453-b11d-8eb9fbc4a767 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038262 Aug 04 21:41:23.127188 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 100/190] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:41:23.134877 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 91/191] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:22 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:23.145673 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a8582b5b-27e6-43dc-b7cb-a5904a6379e5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:23.146480 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a8582b5b-27e6-43dc-b7cb-a5904a6379e5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:23.153632 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a8582b5b-27e6-43dc-b7cb-a5904a6379e5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:23.162637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a8582b5b-27e6-43dc-b7cb-a5904a6379e5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:23.162637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a8582b5b-27e6-43dc-b7cb-a5904a6379e5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:23.162637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a8582b5b-27e6-43dc-b7cb-a5904a6379e5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:23.162637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a8582b5b-27e6-43dc-b7cb-a5904a6379e5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:23.163132 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a8582b5b-27e6-43dc-b7cb-a5904a6379e5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:23.326802 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a8582b5b-27e6-43dc-b7cb-a5904a6379e5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:23.334236 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a8582b5b-27e6-43dc-b7cb-a5904a6379e5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.194208 Aug 04 21:41:23.334794 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 101/192] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:23 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:23.796434 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-fc293954-ef2d-493a-a295-d35133e8deb6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:23.797136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-fc293954-ef2d-493a-a295-d35133e8deb6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:23.803124 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fc293954-ef2d-493a-a295-d35133e8deb6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:23.803796 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fc293954-ef2d-493a-a295-d35133e8deb6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:23.804399 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fc293954-ef2d-493a-a295-d35133e8deb6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:23.805094 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fc293954-ef2d-493a-a295-d35133e8deb6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:23.805632 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fc293954-ef2d-493a-a295-d35133e8deb6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:23.806265 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fc293954-ef2d-493a-a295-d35133e8deb6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:23.811693 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=100 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:41:23.940980 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-fc293954-ef2d-493a-a295-d35133e8deb6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:23.952682 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-fc293954-ef2d-493a-a295-d35133e8deb6 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.161038 Aug 04 21:41:23.953256 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 92/193] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:23 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:24.108896 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-05e0c01d-51ee-482b-84b8-b8a37d1d9d8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:24.109607 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-05e0c01d-51ee-482b-84b8-b8a37d1d9d8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:24.116652 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-05e0c01d-51ee-482b-84b8-b8a37d1d9d8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:24.117599 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-05e0c01d-51ee-482b-84b8-b8a37d1d9d8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:24.118238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-05e0c01d-51ee-482b-84b8-b8a37d1d9d8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:24.119280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-05e0c01d-51ee-482b-84b8-b8a37d1d9d8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:24.120576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-05e0c01d-51ee-482b-84b8-b8a37d1d9d8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:24.121147 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-05e0c01d-51ee-482b-84b8-b8a37d1d9d8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:24.131773 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-7b3fe9ed-c206-4f64-9283-e2e8bb6a0d9c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:24.132631 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7b3fe9ed-c206-4f64-9283-e2e8bb6a0d9c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:24.147625 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7b3fe9ed-c206-4f64-9283-e2e8bb6a0d9c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:24.148142 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7b3fe9ed-c206-4f64-9283-e2e8bb6a0d9c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:24.148578 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7b3fe9ed-c206-4f64-9283-e2e8bb6a0d9c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:24.149290 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7b3fe9ed-c206-4f64-9283-e2e8bb6a0d9c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:24.149733 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7b3fe9ed-c206-4f64-9283-e2e8bb6a0d9c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:24.150178 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7b3fe9ed-c206-4f64-9283-e2e8bb6a0d9c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:24.316734 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-05e0c01d-51ee-482b-84b8-b8a37d1d9d8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:24.325864 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-05e0c01d-51ee-482b-84b8-b8a37d1d9d8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:24.327996 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-05e0c01d-51ee-482b-84b8-b8a37d1d9d8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:24.329152 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-05e0c01d-51ee-482b-84b8-b8a37d1d9d8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.224180 Aug 04 21:41:24.329710 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 102/194] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:24 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:24.350483 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7b3fe9ed-c206-4f64-9283-e2e8bb6a0d9c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:24.354893 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-0239809e-0ec7-48dc-b8a1-b4dc8b9ac240 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:24.355504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-0239809e-0ec7-48dc-b8a1-b4dc8b9ac240 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:24.358702 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-7b3fe9ed-c206-4f64-9283-e2e8bb6a0d9c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.231408 Aug 04 21:41:24.359419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 93/195] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:24 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:24.361689 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0239809e-0ec7-48dc-b8a1-b4dc8b9ac240 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:24.362263 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0239809e-0ec7-48dc-b8a1-b4dc8b9ac240 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:24.362823 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0239809e-0ec7-48dc-b8a1-b4dc8b9ac240 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:24.363524 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0239809e-0ec7-48dc-b8a1-b4dc8b9ac240 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:24.363989 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0239809e-0ec7-48dc-b8a1-b4dc8b9ac240 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:24.364636 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0239809e-0ec7-48dc-b8a1-b4dc8b9ac240 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:24.505009 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-0239809e-0ec7-48dc-b8a1-b4dc8b9ac240 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:24.513099 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-0239809e-0ec7-48dc-b8a1-b4dc8b9ac240 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.162169 Aug 04 21:41:24.513668 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 103/196] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:24 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:24.974837 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-c2be483f-f233-4645-850b-33480f549fa3 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:24.979919 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-c2be483f-f233-4645-850b-33480f549fa3 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:24.987279 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c2be483f-f233-4645-850b-33480f549fa3 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:24.989670 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c2be483f-f233-4645-850b-33480f549fa3 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:24.989670 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c2be483f-f233-4645-850b-33480f549fa3 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:24.989670 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c2be483f-f233-4645-850b-33480f549fa3 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:24.990225 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c2be483f-f233-4645-850b-33480f549fa3 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:24.990647 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c2be483f-f233-4645-850b-33480f549fa3 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:25.121808 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-c2be483f-f233-4645-850b-33480f549fa3 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:25.129492 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-c2be483f-f233-4645-850b-33480f549fa3 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.159320 Aug 04 21:41:25.136837 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 94/197] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:24 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:25.352649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-6e246e7b-5da4-4398-9351-123d92ab7605 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:25.353237 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-6e246e7b-5da4-4398-9351-123d92ab7605 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:25.359763 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e246e7b-5da4-4398-9351-123d92ab7605 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:25.360235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e246e7b-5da4-4398-9351-123d92ab7605 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:25.360657 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e246e7b-5da4-4398-9351-123d92ab7605 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:25.361326 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e246e7b-5da4-4398-9351-123d92ab7605 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:25.361766 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e246e7b-5da4-4398-9351-123d92ab7605 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:25.362213 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e246e7b-5da4-4398-9351-123d92ab7605 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:25.383134 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6d49cdbb-2df7-4fa5-bc10-a0421c30def6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:25.384035 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-6d49cdbb-2df7-4fa5-bc10-a0421c30def6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:25.391195 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6d49cdbb-2df7-4fa5-bc10-a0421c30def6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:25.391946 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6d49cdbb-2df7-4fa5-bc10-a0421c30def6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:25.392559 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6d49cdbb-2df7-4fa5-bc10-a0421c30def6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:25.393253 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6d49cdbb-2df7-4fa5-bc10-a0421c30def6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:25.393698 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6d49cdbb-2df7-4fa5-bc10-a0421c30def6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:25.394329 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6d49cdbb-2df7-4fa5-bc10-a0421c30def6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:25.496068 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6e246e7b-5da4-4398-9351-123d92ab7605 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:25.503882 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6e246e7b-5da4-4398-9351-123d92ab7605 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:25.505469 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6e246e7b-5da4-4398-9351-123d92ab7605 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:25.506687 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-6e246e7b-5da4-4398-9351-123d92ab7605 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.157963 Aug 04 21:41:25.507248 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 104/198] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:25 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:25.526640 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6d49cdbb-2df7-4fa5-bc10-a0421c30def6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:25.535386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-6d49cdbb-2df7-4fa5-bc10-a0421c30def6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.156158 Aug 04 21:41:25.536036 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 95/199] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:25 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:25.537574 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-df186841-54b4-4d4b-9e7e-6a9d213da77a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:25.538227 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-df186841-54b4-4d4b-9e7e-6a9d213da77a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:25.545637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-df186841-54b4-4d4b-9e7e-6a9d213da77a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:25.551071 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-df186841-54b4-4d4b-9e7e-6a9d213da77a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:25.551071 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-df186841-54b4-4d4b-9e7e-6a9d213da77a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:25.551071 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-df186841-54b4-4d4b-9e7e-6a9d213da77a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:25.551071 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-df186841-54b4-4d4b-9e7e-6a9d213da77a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:25.551486 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-df186841-54b4-4d4b-9e7e-6a9d213da77a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:25.678500 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-df186841-54b4-4d4b-9e7e-6a9d213da77a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:25.688754 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-df186841-54b4-4d4b-9e7e-6a9d213da77a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.158468 Aug 04 21:41:25.689347 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 105/200] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:25 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:26.150389 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-9a96434e-f94c-4538-98d0-24fcaea6b13e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:26.151658 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-9a96434e-f94c-4538-98d0-24fcaea6b13e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:26.157666 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9a96434e-f94c-4538-98d0-24fcaea6b13e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:26.158176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9a96434e-f94c-4538-98d0-24fcaea6b13e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:26.158895 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9a96434e-f94c-4538-98d0-24fcaea6b13e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:26.159362 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9a96434e-f94c-4538-98d0-24fcaea6b13e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:26.159800 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9a96434e-f94c-4538-98d0-24fcaea6b13e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:26.160212 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9a96434e-f94c-4538-98d0-24fcaea6b13e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:26.293989 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-9a96434e-f94c-4538-98d0-24fcaea6b13e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:26.301283 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-9a96434e-f94c-4538-98d0-24fcaea6b13e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.154780 Aug 04 21:41:26.301833 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 96/201] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:26 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:26.529645 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-bcd7e28c-155c-4c4b-b6de-e387817d618f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:26.530273 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-bcd7e28c-155c-4c4b-b6de-e387817d618f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:26.536149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bcd7e28c-155c-4c4b-b6de-e387817d618f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:26.536622 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bcd7e28c-155c-4c4b-b6de-e387817d618f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:26.537049 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bcd7e28c-155c-4c4b-b6de-e387817d618f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:26.537720 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bcd7e28c-155c-4c4b-b6de-e387817d618f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:26.538205 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bcd7e28c-155c-4c4b-b6de-e387817d618f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:26.538620 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bcd7e28c-155c-4c4b-b6de-e387817d618f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:26.556394 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e7ae9831-0b84-425d-aa3e-f204ee99fef8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:26.557278 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e7ae9831-0b84-425d-aa3e-f204ee99fef8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:26.563289 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e7ae9831-0b84-425d-aa3e-f204ee99fef8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:26.563762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e7ae9831-0b84-425d-aa3e-f204ee99fef8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:26.564189 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e7ae9831-0b84-425d-aa3e-f204ee99fef8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:26.564868 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e7ae9831-0b84-425d-aa3e-f204ee99fef8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:26.565343 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e7ae9831-0b84-425d-aa3e-f204ee99fef8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:26.565729 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e7ae9831-0b84-425d-aa3e-f204ee99fef8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:26.672362 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-bcd7e28c-155c-4c4b-b6de-e387817d618f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:26.680223 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-bcd7e28c-155c-4c4b-b6de-e387817d618f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:26.681709 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-bcd7e28c-155c-4c4b-b6de-e387817d618f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:26.682949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-bcd7e28c-155c-4c4b-b6de-e387817d618f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.157993 Aug 04 21:41:26.683543 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 106/202] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:26 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:26.694361 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e7ae9831-0b84-425d-aa3e-f204ee99fef8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:26.702307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e7ae9831-0b84-425d-aa3e-f204ee99fef8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.149782 Aug 04 21:41:26.702852 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 97/203] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:26 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:26.710527 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f3d3d328-ba8d-469c-afea-d7d6af2ab2eb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:26.711120 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-f3d3d328-ba8d-469c-afea-d7d6af2ab2eb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:26.717501 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f3d3d328-ba8d-469c-afea-d7d6af2ab2eb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:26.718015 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f3d3d328-ba8d-469c-afea-d7d6af2ab2eb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:26.718477 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f3d3d328-ba8d-469c-afea-d7d6af2ab2eb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:26.719151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f3d3d328-ba8d-469c-afea-d7d6af2ab2eb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:26.719587 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f3d3d328-ba8d-469c-afea-d7d6af2ab2eb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:26.719998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f3d3d328-ba8d-469c-afea-d7d6af2ab2eb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:26.849425 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f3d3d328-ba8d-469c-afea-d7d6af2ab2eb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:26.857493 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f3d3d328-ba8d-469c-afea-d7d6af2ab2eb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.150588 Aug 04 21:41:26.858080 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 107/204] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:26 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:27.322179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-04331487-ab8e-49ad-b983-45e2386d905d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:27.329074 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-04331487-ab8e-49ad-b983-45e2386d905d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:27.329074 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-04331487-ab8e-49ad-b983-45e2386d905d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:27.329536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-04331487-ab8e-49ad-b983-45e2386d905d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:27.329963 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-04331487-ab8e-49ad-b983-45e2386d905d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:27.330833 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-04331487-ab8e-49ad-b983-45e2386d905d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:27.331276 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-04331487-ab8e-49ad-b983-45e2386d905d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:27.331688 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-04331487-ab8e-49ad-b983-45e2386d905d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:27.463047 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-04331487-ab8e-49ad-b983-45e2386d905d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:27.470608 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-04331487-ab8e-49ad-b983-45e2386d905d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.152355 Aug 04 21:41:27.471161 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 98/205] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:27 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:27.705660 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-55cb8534-5d66-49ae-aa4e-d000a6d706f6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:27.706303 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-55cb8534-5d66-49ae-aa4e-d000a6d706f6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:27.712141 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-55cb8534-5d66-49ae-aa4e-d000a6d706f6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:27.712621 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-55cb8534-5d66-49ae-aa4e-d000a6d706f6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:27.713552 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-55cb8534-5d66-49ae-aa4e-d000a6d706f6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:27.714258 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-55cb8534-5d66-49ae-aa4e-d000a6d706f6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:27.714705 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-55cb8534-5d66-49ae-aa4e-d000a6d706f6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:27.715121 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-55cb8534-5d66-49ae-aa4e-d000a6d706f6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:27.722893 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b7d85dc0-497b-4863-8c35-3d8ad0914785 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:27.723506 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b7d85dc0-497b-4863-8c35-3d8ad0914785 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:27.730491 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b7d85dc0-497b-4863-8c35-3d8ad0914785 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:27.731698 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b7d85dc0-497b-4863-8c35-3d8ad0914785 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:27.732128 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b7d85dc0-497b-4863-8c35-3d8ad0914785 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:27.733503 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b7d85dc0-497b-4863-8c35-3d8ad0914785 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:27.733968 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b7d85dc0-497b-4863-8c35-3d8ad0914785 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:27.734390 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b7d85dc0-497b-4863-8c35-3d8ad0914785 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:27.850032 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-55cb8534-5d66-49ae-aa4e-d000a6d706f6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:27.858546 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-55cb8534-5d66-49ae-aa4e-d000a6d706f6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:27.860066 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-55cb8534-5d66-49ae-aa4e-d000a6d706f6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:27.861161 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-55cb8534-5d66-49ae-aa4e-d000a6d706f6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.159400 Aug 04 21:41:27.861714 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 108/206] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:27 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:27.868320 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b7d85dc0-497b-4863-8c35-3d8ad0914785 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:27.876300 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b7d85dc0-497b-4863-8c35-3d8ad0914785 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.157076 Aug 04 21:41:27.877038 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 99/207] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:27 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:27.878982 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e23bc990-10b5-4d47-952e-d6d049ca5757 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:27.879580 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e23bc990-10b5-4d47-952e-d6d049ca5757 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:27.885823 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e23bc990-10b5-4d47-952e-d6d049ca5757 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:27.886338 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e23bc990-10b5-4d47-952e-d6d049ca5757 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:27.886764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e23bc990-10b5-4d47-952e-d6d049ca5757 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:27.887438 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e23bc990-10b5-4d47-952e-d6d049ca5757 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:27.887877 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e23bc990-10b5-4d47-952e-d6d049ca5757 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:27.888323 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e23bc990-10b5-4d47-952e-d6d049ca5757 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:28.020383 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e23bc990-10b5-4d47-952e-d6d049ca5757 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:28.028252 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e23bc990-10b5-4d47-952e-d6d049ca5757 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.152920 Aug 04 21:41:28.028818 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 109/208] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:27 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:28.492180 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-277b0cdb-11b3-4170-922d-707b080e9e09 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:28.493030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-277b0cdb-11b3-4170-922d-707b080e9e09 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:28.498986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-277b0cdb-11b3-4170-922d-707b080e9e09 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:28.499463 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-277b0cdb-11b3-4170-922d-707b080e9e09 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:28.499891 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-277b0cdb-11b3-4170-922d-707b080e9e09 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:28.500574 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-277b0cdb-11b3-4170-922d-707b080e9e09 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:28.501018 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-277b0cdb-11b3-4170-922d-707b080e9e09 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:28.501436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-277b0cdb-11b3-4170-922d-707b080e9e09 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:28.630483 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-277b0cdb-11b3-4170-922d-707b080e9e09 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:28.638731 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-277b0cdb-11b3-4170-922d-707b080e9e09 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.150393 Aug 04 21:41:28.639283 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 100/209] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:28 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:28.886711 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-6c7e8044-f4f5-4733-8b91-0a38c768f1d0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:28.887445 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-6c7e8044-f4f5-4733-8b91-0a38c768f1d0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:28.893708 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6c7e8044-f4f5-4733-8b91-0a38c768f1d0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:28.894237 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6c7e8044-f4f5-4733-8b91-0a38c768f1d0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:28.894669 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6c7e8044-f4f5-4733-8b91-0a38c768f1d0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:28.895356 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6c7e8044-f4f5-4733-8b91-0a38c768f1d0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:28.895800 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6c7e8044-f4f5-4733-8b91-0a38c768f1d0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:28.896218 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6c7e8044-f4f5-4733-8b91-0a38c768f1d0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:28.896520 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e03fdcce-b2f1-4a70-b935-ccb143ef3f67 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:28.897125 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e03fdcce-b2f1-4a70-b935-ccb143ef3f67 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:28.903757 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e03fdcce-b2f1-4a70-b935-ccb143ef3f67 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:28.904236 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e03fdcce-b2f1-4a70-b935-ccb143ef3f67 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:28.904673 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e03fdcce-b2f1-4a70-b935-ccb143ef3f67 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:28.905355 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e03fdcce-b2f1-4a70-b935-ccb143ef3f67 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:28.905801 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e03fdcce-b2f1-4a70-b935-ccb143ef3f67 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:28.906259 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e03fdcce-b2f1-4a70-b935-ccb143ef3f67 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:29.031883 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6c7e8044-f4f5-4733-8b91-0a38c768f1d0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:29.035612 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=100 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:41:29.043658 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e03fdcce-b2f1-4a70-b935-ccb143ef3f67 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:29.043983 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6c7e8044-f4f5-4733-8b91-0a38c768f1d0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:29.043983 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6c7e8044-f4f5-4733-8b91-0a38c768f1d0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:29.043983 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-6c7e8044-f4f5-4733-8b91-0a38c768f1d0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.161602 Aug 04 21:41:29.044349 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 110/210] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:28 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:29.049182 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-fcc4fa0a-e0fb-4395-baa3-3c94f21f7f1c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:29.049791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-fcc4fa0a-e0fb-4395-baa3-3c94f21f7f1c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:29.055899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e03fdcce-b2f1-4a70-b935-ccb143ef3f67 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.162960 Aug 04 21:41:29.056100 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fcc4fa0a-e0fb-4395-baa3-3c94f21f7f1c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:29.056596 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fcc4fa0a-e0fb-4395-baa3-3c94f21f7f1c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:29.057251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 101/211] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:28 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:29.057557 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fcc4fa0a-e0fb-4395-baa3-3c94f21f7f1c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:29.058451 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fcc4fa0a-e0fb-4395-baa3-3c94f21f7f1c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:29.058901 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fcc4fa0a-e0fb-4395-baa3-3c94f21f7f1c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:29.059320 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fcc4fa0a-e0fb-4395-baa3-3c94f21f7f1c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:29.191325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-fcc4fa0a-e0fb-4395-baa3-3c94f21f7f1c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:29.200394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-fcc4fa0a-e0fb-4395-baa3-3c94f21f7f1c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.155108 Aug 04 21:41:29.201128 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 111/212] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:29 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:29.660755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-369f0c46-d0a0-4056-a296-923385520425 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:29.661308 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-369f0c46-d0a0-4056-a296-923385520425 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:29.667769 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-369f0c46-d0a0-4056-a296-923385520425 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:29.668243 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-369f0c46-d0a0-4056-a296-923385520425 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:29.668670 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-369f0c46-d0a0-4056-a296-923385520425 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:29.669347 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-369f0c46-d0a0-4056-a296-923385520425 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:29.669794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-369f0c46-d0a0-4056-a296-923385520425 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:29.670239 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-369f0c46-d0a0-4056-a296-923385520425 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:29.800018 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-369f0c46-d0a0-4056-a296-923385520425 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:29.807450 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-369f0c46-d0a0-4056-a296-923385520425 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.150801 Aug 04 21:41:29.808165 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 102/213] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:29 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:30.073216 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-8d79dcf0-e62b-4d8e-a15c-77567577988e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:30.073992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-8d79dcf0-e62b-4d8e-a15c-77567577988e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:30.082319 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8d79dcf0-e62b-4d8e-a15c-77567577988e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:30.082803 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a4c5b254-3d4d-4e32-acd4-8fddb3cba08b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:30.083241 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8d79dcf0-e62b-4d8e-a15c-77567577988e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:30.083804 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8d79dcf0-e62b-4d8e-a15c-77567577988e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:30.084166 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-a4c5b254-3d4d-4e32-acd4-8fddb3cba08b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:30.085009 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8d79dcf0-e62b-4d8e-a15c-77567577988e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:30.085690 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8d79dcf0-e62b-4d8e-a15c-77567577988e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:30.086234 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8d79dcf0-e62b-4d8e-a15c-77567577988e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:30.092487 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a4c5b254-3d4d-4e32-acd4-8fddb3cba08b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:30.092981 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a4c5b254-3d4d-4e32-acd4-8fddb3cba08b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:30.093474 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a4c5b254-3d4d-4e32-acd4-8fddb3cba08b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:30.094215 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a4c5b254-3d4d-4e32-acd4-8fddb3cba08b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:30.094667 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a4c5b254-3d4d-4e32-acd4-8fddb3cba08b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:30.095292 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a4c5b254-3d4d-4e32-acd4-8fddb3cba08b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:30.252945 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8d79dcf0-e62b-4d8e-a15c-77567577988e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:30.262466 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8d79dcf0-e62b-4d8e-a15c-77567577988e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:30.264121 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8d79dcf0-e62b-4d8e-a15c-77567577988e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:30.265310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-8d79dcf0-e62b-4d8e-a15c-77567577988e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.197251 Aug 04 21:41:30.265878 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 112/214] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:30 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:30.270524 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-3450f5f6-6f8a-4d1f-b301-7ac8ecf7574d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:30.273708 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-3450f5f6-6f8a-4d1f-b301-7ac8ecf7574d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:30.277219 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3450f5f6-6f8a-4d1f-b301-7ac8ecf7574d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:30.277691 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3450f5f6-6f8a-4d1f-b301-7ac8ecf7574d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:30.278366 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3450f5f6-6f8a-4d1f-b301-7ac8ecf7574d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:30.279044 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3450f5f6-6f8a-4d1f-b301-7ac8ecf7574d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:30.279488 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3450f5f6-6f8a-4d1f-b301-7ac8ecf7574d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:30.279914 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3450f5f6-6f8a-4d1f-b301-7ac8ecf7574d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:30.293301 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-a4c5b254-3d4d-4e32-acd4-8fddb3cba08b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:30.301037 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-a4c5b254-3d4d-4e32-acd4-8fddb3cba08b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.222896 Aug 04 21:41:30.306697 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 103/215] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:30 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:30.419821 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-3450f5f6-6f8a-4d1f-b301-7ac8ecf7574d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:30.427118 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-3450f5f6-6f8a-4d1f-b301-7ac8ecf7574d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.160218 Aug 04 21:41:30.427625 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 113/216] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:30 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:30.828305 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-c7433f57-e0fe-4652-8dc0-b2366211b058 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:30.829009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-c7433f57-e0fe-4652-8dc0-b2366211b058 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:30.835398 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c7433f57-e0fe-4652-8dc0-b2366211b058 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:30.835880 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c7433f57-e0fe-4652-8dc0-b2366211b058 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:30.836304 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c7433f57-e0fe-4652-8dc0-b2366211b058 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:30.837013 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c7433f57-e0fe-4652-8dc0-b2366211b058 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:30.837437 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c7433f57-e0fe-4652-8dc0-b2366211b058 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:30.837847 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c7433f57-e0fe-4652-8dc0-b2366211b058 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:30.972894 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-c7433f57-e0fe-4652-8dc0-b2366211b058 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:30.987798 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-c7433f57-e0fe-4652-8dc0-b2366211b058 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.162594 Aug 04 21:41:30.988750 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 104/217] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:30 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:31.292967 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-32692304-82eb-463e-aca2-ab708bc517e2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:31.293577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-32692304-82eb-463e-aca2-ab708bc517e2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:31.300274 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-32692304-82eb-463e-aca2-ab708bc517e2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:31.300833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-32692304-82eb-463e-aca2-ab708bc517e2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:31.305408 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-32692304-82eb-463e-aca2-ab708bc517e2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:31.305408 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-32692304-82eb-463e-aca2-ab708bc517e2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:31.305408 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-32692304-82eb-463e-aca2-ab708bc517e2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:31.305408 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-32692304-82eb-463e-aca2-ab708bc517e2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:31.326314 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f6e4b12e-5779-4014-8a08-036c41eb8714 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:31.327283 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-f6e4b12e-5779-4014-8a08-036c41eb8714 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:31.333563 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f6e4b12e-5779-4014-8a08-036c41eb8714 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:31.337748 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f6e4b12e-5779-4014-8a08-036c41eb8714 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:31.338946 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f6e4b12e-5779-4014-8a08-036c41eb8714 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:31.340164 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f6e4b12e-5779-4014-8a08-036c41eb8714 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:31.340633 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f6e4b12e-5779-4014-8a08-036c41eb8714 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:31.342202 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f6e4b12e-5779-4014-8a08-036c41eb8714 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:31.437889 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-32692304-82eb-463e-aca2-ab708bc517e2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:31.447931 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-32692304-82eb-463e-aca2-ab708bc517e2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:31.449655 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-32692304-82eb-463e-aca2-ab708bc517e2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:31.450817 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-32692304-82eb-463e-aca2-ab708bc517e2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.162608 Aug 04 21:41:31.451380 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 114/218] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:31 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:31.455751 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a0353abc-7c93-4971-b4d2-2717d6a3f1ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:31.462046 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a0353abc-7c93-4971-b4d2-2717d6a3f1ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:31.468191 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0353abc-7c93-4971-b4d2-2717d6a3f1ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:31.468683 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0353abc-7c93-4971-b4d2-2717d6a3f1ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:31.469117 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0353abc-7c93-4971-b4d2-2717d6a3f1ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:31.469853 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0353abc-7c93-4971-b4d2-2717d6a3f1ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:31.470340 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0353abc-7c93-4971-b4d2-2717d6a3f1ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:31.470769 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0353abc-7c93-4971-b4d2-2717d6a3f1ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:31.482586 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-f6e4b12e-5779-4014-8a08-036c41eb8714 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:31.492068 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-f6e4b12e-5779-4014-8a08-036c41eb8714 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.169994 Aug 04 21:41:31.493304 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 105/219] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:31 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:31.606218 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a0353abc-7c93-4971-b4d2-2717d6a3f1ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:31.613834 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a0353abc-7c93-4971-b4d2-2717d6a3f1ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.161479 Aug 04 21:41:31.614426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 115/220] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:31 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:32.013514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2ebe7cc3-46e4-42be-94d6-c6b33665d941 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:32.014168 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2ebe7cc3-46e4-42be-94d6-c6b33665d941 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:32.020445 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2ebe7cc3-46e4-42be-94d6-c6b33665d941 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:32.021085 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2ebe7cc3-46e4-42be-94d6-c6b33665d941 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:32.021745 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2ebe7cc3-46e4-42be-94d6-c6b33665d941 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:32.022509 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2ebe7cc3-46e4-42be-94d6-c6b33665d941 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:32.023013 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2ebe7cc3-46e4-42be-94d6-c6b33665d941 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:32.023728 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2ebe7cc3-46e4-42be-94d6-c6b33665d941 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:32.199133 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-14c88f8d-1550-4129-9390-d7474f121e78 req-2bdaeefd-d471-4af2-95b5-054789c2fc38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf234f88-9a79-4880-92c5-4d2a1c1c379f", "name": "network-vif-plugged", "status": "completed", "tag": "2a939ca2-97e4-4f58-a55a-e99d3c75b212"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:41:32.210288 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-14c88f8d-1550-4129-9390-d7474f121e78 req-2bdaeefd-d471-4af2-95b5-054789c2fc38 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:32.210871 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-14c88f8d-1550-4129-9390-d7474f121e78 req-2bdaeefd-d471-4af2-95b5-054789c2fc38 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:32.211300 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-14c88f8d-1550-4129-9390-d7474f121e78 req-2bdaeefd-d471-4af2-95b5-054789c2fc38 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:32.217727 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2ebe7cc3-46e4-42be-94d6-c6b33665d941 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:32.223429 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-14c88f8d-1550-4129-9390-d7474f121e78 req-2bdaeefd-d471-4af2-95b5-054789c2fc38 service nova] Creating event network-vif-plugged:2a939ca2-97e4-4f58-a55a-e99d3c75b212 for instance cf234f88-9a79-4880-92c5-4d2a1c1c379f on hv-cinder-85220 Aug 04 21:41:32.228439 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-14c88f8d-1550-4129-9390-d7474f121e78 req-2bdaeefd-d471-4af2-95b5-054789c2fc38 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033334 Aug 04 21:41:32.230353 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 116/221] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:41:32.236834 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2ebe7cc3-46e4-42be-94d6-c6b33665d941 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.228515 Aug 04 21:41:32.237436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 106/222] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:32 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:32.475495 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-541358a4-274c-44f4-93bf-866e79eee57d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:32.476182 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-541358a4-274c-44f4-93bf-866e79eee57d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:32.483131 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-541358a4-274c-44f4-93bf-866e79eee57d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:32.483612 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-541358a4-274c-44f4-93bf-866e79eee57d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:32.484162 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-541358a4-274c-44f4-93bf-866e79eee57d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:32.484829 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-541358a4-274c-44f4-93bf-866e79eee57d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:32.485274 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-541358a4-274c-44f4-93bf-866e79eee57d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:32.485684 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-541358a4-274c-44f4-93bf-866e79eee57d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:32.516282 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-22e56080-ef0b-458a-bea5-6de8e9e309a7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:32.517455 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-22e56080-ef0b-458a-bea5-6de8e9e309a7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:32.543080 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-22e56080-ef0b-458a-bea5-6de8e9e309a7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:32.543982 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-22e56080-ef0b-458a-bea5-6de8e9e309a7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:32.544812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-22e56080-ef0b-458a-bea5-6de8e9e309a7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:32.548480 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-22e56080-ef0b-458a-bea5-6de8e9e309a7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:32.549028 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-22e56080-ef0b-458a-bea5-6de8e9e309a7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:32.555754 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-22e56080-ef0b-458a-bea5-6de8e9e309a7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:32.681404 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-541358a4-274c-44f4-93bf-866e79eee57d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:32.690585 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-541358a4-274c-44f4-93bf-866e79eee57d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:32.692570 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-541358a4-274c-44f4-93bf-866e79eee57d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:32.693687 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-541358a4-274c-44f4-93bf-866e79eee57d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.222584 Aug 04 21:41:32.694255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 117/223] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:32 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:32.714247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-4e906e8e-d72c-4f93-be99-818fb88877bb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:32.714837 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-22e56080-ef0b-458a-bea5-6de8e9e309a7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:32.714989 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-4e906e8e-d72c-4f93-be99-818fb88877bb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:32.720787 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4e906e8e-d72c-4f93-be99-818fb88877bb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:32.721265 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4e906e8e-d72c-4f93-be99-818fb88877bb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:32.721688 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4e906e8e-d72c-4f93-be99-818fb88877bb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:32.722408 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4e906e8e-d72c-4f93-be99-818fb88877bb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:32.722851 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4e906e8e-d72c-4f93-be99-818fb88877bb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:32.723262 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4e906e8e-d72c-4f93-be99-818fb88877bb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:32.723880 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-22e56080-ef0b-458a-bea5-6de8e9e309a7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.212688 Aug 04 21:41:32.724732 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 107/224] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:32 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:32.891198 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4e906e8e-d72c-4f93-be99-818fb88877bb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:32.898912 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-4e906e8e-d72c-4f93-be99-818fb88877bb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.191645 Aug 04 21:41:32.899470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 118/225] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:32 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:33.262350 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2a440e59-ff63-4cde-bad9-2c3f0859ce5d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:33.269473 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2a440e59-ff63-4cde-bad9-2c3f0859ce5d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:33.269473 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2a440e59-ff63-4cde-bad9-2c3f0859ce5d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:33.269473 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2a440e59-ff63-4cde-bad9-2c3f0859ce5d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:33.269744 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2a440e59-ff63-4cde-bad9-2c3f0859ce5d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:33.270382 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2a440e59-ff63-4cde-bad9-2c3f0859ce5d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:33.270820 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2a440e59-ff63-4cde-bad9-2c3f0859ce5d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:33.271245 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2a440e59-ff63-4cde-bad9-2c3f0859ce5d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:33.408684 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2a440e59-ff63-4cde-bad9-2c3f0859ce5d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:33.412037 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=100 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:41:33.416824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2a440e59-ff63-4cde-bad9-2c3f0859ce5d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.158658 Aug 04 21:41:33.417518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 108/226] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:33 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:33.720325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-94a88def-de7f-4005-a6e5-76ed4a2a1ef7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:33.720930 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-94a88def-de7f-4005-a6e5-76ed4a2a1ef7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:33.726874 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-94a88def-de7f-4005-a6e5-76ed4a2a1ef7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:33.727350 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-94a88def-de7f-4005-a6e5-76ed4a2a1ef7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:33.727781 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-94a88def-de7f-4005-a6e5-76ed4a2a1ef7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:33.728501 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-94a88def-de7f-4005-a6e5-76ed4a2a1ef7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:33.729154 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-94a88def-de7f-4005-a6e5-76ed4a2a1ef7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:33.729874 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-94a88def-de7f-4005-a6e5-76ed4a2a1ef7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:33.749839 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a41771c6-e8cb-4eb4-979a-561a11f9f24b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:33.750559 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-a41771c6-e8cb-4eb4-979a-561a11f9f24b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:33.756900 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a41771c6-e8cb-4eb4-979a-561a11f9f24b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:33.757456 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a41771c6-e8cb-4eb4-979a-561a11f9f24b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:33.757876 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a41771c6-e8cb-4eb4-979a-561a11f9f24b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:33.758599 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a41771c6-e8cb-4eb4-979a-561a11f9f24b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:33.759186 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a41771c6-e8cb-4eb4-979a-561a11f9f24b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:33.759762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a41771c6-e8cb-4eb4-979a-561a11f9f24b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:33.871919 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-94a88def-de7f-4005-a6e5-76ed4a2a1ef7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:33.880586 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-94a88def-de7f-4005-a6e5-76ed4a2a1ef7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:33.882110 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-94a88def-de7f-4005-a6e5-76ed4a2a1ef7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:33.883546 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-94a88def-de7f-4005-a6e5-76ed4a2a1ef7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.167316 Aug 04 21:41:33.884320 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 119/227] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:33 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:33.907538 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-a41771c6-e8cb-4eb4-979a-561a11f9f24b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:33.915420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-a41771c6-e8cb-4eb4-979a-561a11f9f24b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.169818 Aug 04 21:41:33.916528 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 109/228] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:33 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:33.920187 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e72b732a-bd59-408b-9a37-d92650f570b2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:33.920795 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e72b732a-bd59-408b-9a37-d92650f570b2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:33.926858 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e72b732a-bd59-408b-9a37-d92650f570b2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:33.927349 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e72b732a-bd59-408b-9a37-d92650f570b2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:33.927781 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e72b732a-bd59-408b-9a37-d92650f570b2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:33.928460 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e72b732a-bd59-408b-9a37-d92650f570b2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:33.928940 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e72b732a-bd59-408b-9a37-d92650f570b2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:33.929411 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e72b732a-bd59-408b-9a37-d92650f570b2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:34.066866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e72b732a-bd59-408b-9a37-d92650f570b2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:34.074374 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e72b732a-bd59-408b-9a37-d92650f570b2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.158789 Aug 04 21:41:34.074937 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 120/229] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:33 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:34.244919 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-cd08ebb8-95fd-44b2-b121-6f9655af70d9 req-57d5a559-79b3-40a2-a272-e797acf894c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbeea630-d67b-4f89-a329-c7066d506126", "name": "network-vif-plugged", "status": "completed", "tag": "b245eeb4-95cf-45b5-8d69-591f776623e4"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:41:34.254736 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-cd08ebb8-95fd-44b2-b121-6f9655af70d9 req-57d5a559-79b3-40a2-a272-e797acf894c7 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:34.255210 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-cd08ebb8-95fd-44b2-b121-6f9655af70d9 req-57d5a559-79b3-40a2-a272-e797acf894c7 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:34.255691 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-cd08ebb8-95fd-44b2-b121-6f9655af70d9 req-57d5a559-79b3-40a2-a272-e797acf894c7 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:34.267292 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-cd08ebb8-95fd-44b2-b121-6f9655af70d9 req-57d5a559-79b3-40a2-a272-e797acf894c7 service nova] Creating event network-vif-plugged:b245eeb4-95cf-45b5-8d69-591f776623e4 for instance dbeea630-d67b-4f89-a329-c7066d506126 on hv-cinder-85220 Aug 04 21:41:34.272534 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-cd08ebb8-95fd-44b2-b121-6f9655af70d9 req-57d5a559-79b3-40a2-a272-e797acf894c7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032212 Aug 04 21:41:34.273149 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 110/230] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:41:34.438467 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c1e24839-a484-4d63-8242-ac79366ba26d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:34.439070 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c1e24839-a484-4d63-8242-ac79366ba26d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:34.445233 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c1e24839-a484-4d63-8242-ac79366ba26d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:34.445639 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c1e24839-a484-4d63-8242-ac79366ba26d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:34.446094 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c1e24839-a484-4d63-8242-ac79366ba26d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:34.446807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c1e24839-a484-4d63-8242-ac79366ba26d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:34.447253 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c1e24839-a484-4d63-8242-ac79366ba26d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:34.447668 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c1e24839-a484-4d63-8242-ac79366ba26d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:34.588794 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-c1e24839-a484-4d63-8242-ac79366ba26d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:34.596063 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c1e24839-a484-4d63-8242-ac79366ba26d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.161722 Aug 04 21:41:34.596621 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 121/231] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:34 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:34.908202 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-387c053e-96ad-4b4a-8668-310f556f9359 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:34.908995 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-387c053e-96ad-4b4a-8668-310f556f9359 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:34.915141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-387c053e-96ad-4b4a-8668-310f556f9359 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:34.915619 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-387c053e-96ad-4b4a-8668-310f556f9359 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:34.916873 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-387c053e-96ad-4b4a-8668-310f556f9359 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:34.917657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-387c053e-96ad-4b4a-8668-310f556f9359 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:34.918165 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-387c053e-96ad-4b4a-8668-310f556f9359 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:34.918625 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-387c053e-96ad-4b4a-8668-310f556f9359 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:34.936660 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-62595893-3680-4266-a209-de9382d94ea6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:34.937291 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-62595893-3680-4266-a209-de9382d94ea6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:34.944439 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62595893-3680-4266-a209-de9382d94ea6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:34.944923 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62595893-3680-4266-a209-de9382d94ea6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:34.945360 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62595893-3680-4266-a209-de9382d94ea6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:34.950145 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62595893-3680-4266-a209-de9382d94ea6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:34.950145 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62595893-3680-4266-a209-de9382d94ea6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:34.950145 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62595893-3680-4266-a209-de9382d94ea6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:35.098302 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-387c053e-96ad-4b4a-8668-310f556f9359 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:35.108713 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-387c053e-96ad-4b4a-8668-310f556f9359 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:35.127600 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-387c053e-96ad-4b4a-8668-310f556f9359 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:35.127600 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-387c053e-96ad-4b4a-8668-310f556f9359 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.207752 Aug 04 21:41:35.127600 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 111/232] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:34 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:35.136121 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-13784c9f-b920-4034-be11-c6dfa0e00512 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:35.136893 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-13784c9f-b920-4034-be11-c6dfa0e00512 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:35.143106 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-13784c9f-b920-4034-be11-c6dfa0e00512 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:35.143617 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-13784c9f-b920-4034-be11-c6dfa0e00512 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:35.144220 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-13784c9f-b920-4034-be11-c6dfa0e00512 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:35.144914 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-13784c9f-b920-4034-be11-c6dfa0e00512 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:35.145549 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-13784c9f-b920-4034-be11-c6dfa0e00512 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:35.146031 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-13784c9f-b920-4034-be11-c6dfa0e00512 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:35.174402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-62595893-3680-4266-a209-de9382d94ea6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:35.184722 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-62595893-3680-4266-a209-de9382d94ea6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.251698 Aug 04 21:41:35.194057 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 122/233] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:34 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:35.328832 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-13784c9f-b920-4034-be11-c6dfa0e00512 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:35.336518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-13784c9f-b920-4034-be11-c6dfa0e00512 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.222250 Aug 04 21:41:35.337089 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 112/234] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:35 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:35.618923 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-fcf4414c-e206-49f8-aa08-adbc47aa23d7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:35.620137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-fcf4414c-e206-49f8-aa08-adbc47aa23d7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:35.626751 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fcf4414c-e206-49f8-aa08-adbc47aa23d7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:35.627383 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fcf4414c-e206-49f8-aa08-adbc47aa23d7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:35.627811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fcf4414c-e206-49f8-aa08-adbc47aa23d7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:35.628510 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fcf4414c-e206-49f8-aa08-adbc47aa23d7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:35.628968 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fcf4414c-e206-49f8-aa08-adbc47aa23d7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:35.629392 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fcf4414c-e206-49f8-aa08-adbc47aa23d7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:35.774903 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-fcf4414c-e206-49f8-aa08-adbc47aa23d7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:35.782898 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-fcf4414c-e206-49f8-aa08-adbc47aa23d7 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.168719 Aug 04 21:41:35.783465 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 123/235] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:35 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:36.143231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-30913099-0e51-4dcb-bf81-a387e2a31d01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:36.146758 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-30913099-0e51-4dcb-bf81-a387e2a31d01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:36.160238 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-30913099-0e51-4dcb-bf81-a387e2a31d01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:36.163893 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-30913099-0e51-4dcb-bf81-a387e2a31d01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:36.166584 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-30913099-0e51-4dcb-bf81-a387e2a31d01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:36.167702 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-30913099-0e51-4dcb-bf81-a387e2a31d01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:36.168240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-30913099-0e51-4dcb-bf81-a387e2a31d01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:36.171389 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-30913099-0e51-4dcb-bf81-a387e2a31d01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:36.206896 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b0f93113-bfc6-47d4-88a2-eb35befbca0e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:36.207580 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b0f93113-bfc6-47d4-88a2-eb35befbca0e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:36.220324 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b0f93113-bfc6-47d4-88a2-eb35befbca0e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:36.220449 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b0f93113-bfc6-47d4-88a2-eb35befbca0e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:36.220821 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b0f93113-bfc6-47d4-88a2-eb35befbca0e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:36.221719 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b0f93113-bfc6-47d4-88a2-eb35befbca0e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:36.222413 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b0f93113-bfc6-47d4-88a2-eb35befbca0e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:36.223001 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b0f93113-bfc6-47d4-88a2-eb35befbca0e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:36.418955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b0f93113-bfc6-47d4-88a2-eb35befbca0e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:36.437266 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-30913099-0e51-4dcb-bf81-a387e2a31d01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:36.455056 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-30913099-0e51-4dcb-bf81-a387e2a31d01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:36.457048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-30913099-0e51-4dcb-bf81-a387e2a31d01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:36.458528 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-30913099-0e51-4dcb-bf81-a387e2a31d01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.321268 Aug 04 21:41:36.459971 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 113/236] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:36 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:36.462330 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b0f93113-bfc6-47d4-88a2-eb35befbca0e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.259516 Aug 04 21:41:36.466558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 124/237] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:36 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:36.476782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-3545302a-1b8a-42a3-9757-b8611bc7c928 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:36.477423 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-3545302a-1b8a-42a3-9757-b8611bc7c928 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:36.484610 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3545302a-1b8a-42a3-9757-b8611bc7c928 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:36.485099 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3545302a-1b8a-42a3-9757-b8611bc7c928 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:36.485965 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3545302a-1b8a-42a3-9757-b8611bc7c928 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:36.490964 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3545302a-1b8a-42a3-9757-b8611bc7c928 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:36.498185 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3545302a-1b8a-42a3-9757-b8611bc7c928 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:36.498730 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3545302a-1b8a-42a3-9757-b8611bc7c928 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:36.727567 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-3545302a-1b8a-42a3-9757-b8611bc7c928 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:36.735232 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-3545302a-1b8a-42a3-9757-b8611bc7c928 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.273694 Aug 04 21:41:36.735823 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 114/238] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:36 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:36.804404 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-81e32964-0c21-4ac4-8497-0bd28d5b8f7e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:36.805021 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-81e32964-0c21-4ac4-8497-0bd28d5b8f7e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:36.811273 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-81e32964-0c21-4ac4-8497-0bd28d5b8f7e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:36.812073 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-81e32964-0c21-4ac4-8497-0bd28d5b8f7e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:36.812567 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-81e32964-0c21-4ac4-8497-0bd28d5b8f7e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:36.813333 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-81e32964-0c21-4ac4-8497-0bd28d5b8f7e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:36.813862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-81e32964-0c21-4ac4-8497-0bd28d5b8f7e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:36.814402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-81e32964-0c21-4ac4-8497-0bd28d5b8f7e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:36.952373 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-81e32964-0c21-4ac4-8497-0bd28d5b8f7e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:36.960681 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-81e32964-0c21-4ac4-8497-0bd28d5b8f7e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1315 microversion: 2.1 time: 0.160326 Aug 04 21:41:36.961269 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 125/239] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:36 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:37.484277 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ab25955e-e70e-486f-8baf-e66f8e580cc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:37.484986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ab25955e-e70e-486f-8baf-e66f8e580cc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:37.486816 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2488aa67-fe1b-42ea-ad1a-b5c3c6bbd5f1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:37.487888 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-2488aa67-fe1b-42ea-ad1a-b5c3c6bbd5f1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:37.495263 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ab25955e-e70e-486f-8baf-e66f8e580cc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:37.495263 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ab25955e-e70e-486f-8baf-e66f8e580cc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:37.495263 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ab25955e-e70e-486f-8baf-e66f8e580cc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:37.495263 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ab25955e-e70e-486f-8baf-e66f8e580cc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:37.495878 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2488aa67-fe1b-42ea-ad1a-b5c3c6bbd5f1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:37.495969 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ab25955e-e70e-486f-8baf-e66f8e580cc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:37.496540 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ab25955e-e70e-486f-8baf-e66f8e580cc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:37.499839 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2488aa67-fe1b-42ea-ad1a-b5c3c6bbd5f1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:37.500483 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2488aa67-fe1b-42ea-ad1a-b5c3c6bbd5f1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:37.501425 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2488aa67-fe1b-42ea-ad1a-b5c3c6bbd5f1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:37.501895 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2488aa67-fe1b-42ea-ad1a-b5c3c6bbd5f1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:37.502402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2488aa67-fe1b-42ea-ad1a-b5c3c6bbd5f1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:37.708283 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ab25955e-e70e-486f-8baf-e66f8e580cc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:37.717212 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ab25955e-e70e-486f-8baf-e66f8e580cc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:37.718773 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ab25955e-e70e-486f-8baf-e66f8e580cc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:37.719999 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ab25955e-e70e-486f-8baf-e66f8e580cc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.239931 Aug 04 21:41:37.720553 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 115/240] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:37 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:37.756236 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-17d16208-4ac6-4f3c-a902-7c10ea87f8b2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:37.756855 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-17d16208-4ac6-4f3c-a902-7c10ea87f8b2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:37.763543 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-17d16208-4ac6-4f3c-a902-7c10ea87f8b2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:37.764140 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-17d16208-4ac6-4f3c-a902-7c10ea87f8b2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:37.764574 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-17d16208-4ac6-4f3c-a902-7c10ea87f8b2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:37.765266 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-17d16208-4ac6-4f3c-a902-7c10ea87f8b2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:37.765707 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-17d16208-4ac6-4f3c-a902-7c10ea87f8b2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:37.766144 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-17d16208-4ac6-4f3c-a902-7c10ea87f8b2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:37.791787 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2488aa67-fe1b-42ea-ad1a-b5c3c6bbd5f1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:37.800289 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2488aa67-fe1b-42ea-ad1a-b5c3c6bbd5f1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.317258 Aug 04 21:41:37.803292 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 126/241] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:37 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:37.904163 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-17d16208-4ac6-4f3c-a902-7c10ea87f8b2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:37.913387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-17d16208-4ac6-4f3c-a902-7c10ea87f8b2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.160981 Aug 04 21:41:37.926564 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 116/242] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:37 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:37.983490 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f7d1b92b-14d7-4624-9cc2-02a54ec61216 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:37.984098 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-f7d1b92b-14d7-4624-9cc2-02a54ec61216 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:37.990544 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f7d1b92b-14d7-4624-9cc2-02a54ec61216 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:37.991033 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f7d1b92b-14d7-4624-9cc2-02a54ec61216 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:37.991464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f7d1b92b-14d7-4624-9cc2-02a54ec61216 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:37.992164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f7d1b92b-14d7-4624-9cc2-02a54ec61216 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:37.992866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f7d1b92b-14d7-4624-9cc2-02a54ec61216 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:37.993281 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f7d1b92b-14d7-4624-9cc2-02a54ec61216 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:38.181523 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f7d1b92b-14d7-4624-9cc2-02a54ec61216 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:38.188949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f7d1b92b-14d7-4624-9cc2-02a54ec61216 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1503 microversion: 2.1 time: 0.209457 Aug 04 21:41:38.194875 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 127/243] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:37 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1503 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:38.744913 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d7bdee3f-3048-49a0-878d-ec865e9c4e5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:38.745418 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d7bdee3f-3048-49a0-878d-ec865e9c4e5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:38.751763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d7bdee3f-3048-49a0-878d-ec865e9c4e5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:38.752243 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d7bdee3f-3048-49a0-878d-ec865e9c4e5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:38.752668 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d7bdee3f-3048-49a0-878d-ec865e9c4e5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:38.753890 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d7bdee3f-3048-49a0-878d-ec865e9c4e5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:38.754369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d7bdee3f-3048-49a0-878d-ec865e9c4e5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:38.754785 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d7bdee3f-3048-49a0-878d-ec865e9c4e5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:38.825364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-bf170825-4707-42aa-9a9f-60c8a289fab4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:38.825952 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-bf170825-4707-42aa-9a9f-60c8a289fab4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:38.831886 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bf170825-4707-42aa-9a9f-60c8a289fab4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:38.832376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bf170825-4707-42aa-9a9f-60c8a289fab4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:38.832836 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bf170825-4707-42aa-9a9f-60c8a289fab4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:38.833980 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bf170825-4707-42aa-9a9f-60c8a289fab4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:38.834501 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bf170825-4707-42aa-9a9f-60c8a289fab4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:38.834955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bf170825-4707-42aa-9a9f-60c8a289fab4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:38.852013 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=100 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:41:38.898912 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d7bdee3f-3048-49a0-878d-ec865e9c4e5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:38.919184 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d7bdee3f-3048-49a0-878d-ec865e9c4e5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:38.921844 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d7bdee3f-3048-49a0-878d-ec865e9c4e5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:38.923753 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d7bdee3f-3048-49a0-878d-ec865e9c4e5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.184245 Aug 04 21:41:38.934051 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 117/244] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:38 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:38.937971 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8bdf63b7-9497-40f3-85a0-6fba04db7380 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:38.938606 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8bdf63b7-9497-40f3-85a0-6fba04db7380 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:38.946478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8bdf63b7-9497-40f3-85a0-6fba04db7380 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:38.947086 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8bdf63b7-9497-40f3-85a0-6fba04db7380 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:38.953904 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8bdf63b7-9497-40f3-85a0-6fba04db7380 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:38.954839 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8bdf63b7-9497-40f3-85a0-6fba04db7380 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:38.955310 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8bdf63b7-9497-40f3-85a0-6fba04db7380 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:38.955838 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8bdf63b7-9497-40f3-85a0-6fba04db7380 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:39.028964 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-bf170825-4707-42aa-9a9f-60c8a289fab4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:39.036219 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-bf170825-4707-42aa-9a9f-60c8a289fab4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.215708 Aug 04 21:41:39.036788 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 128/245] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:38 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:39.117369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8bdf63b7-9497-40f3-85a0-6fba04db7380 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:39.126186 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8bdf63b7-9497-40f3-85a0-6fba04db7380 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.193158 Aug 04 21:41:39.126758 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 118/246] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:38 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:39.948016 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-fa09d5c0-8fed-455b-8b07-54d375670d28 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:39.948636 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-fa09d5c0-8fed-455b-8b07-54d375670d28 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:39.954738 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fa09d5c0-8fed-455b-8b07-54d375670d28 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:39.955225 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fa09d5c0-8fed-455b-8b07-54d375670d28 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:39.955652 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fa09d5c0-8fed-455b-8b07-54d375670d28 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:39.956331 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fa09d5c0-8fed-455b-8b07-54d375670d28 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:39.956780 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fa09d5c0-8fed-455b-8b07-54d375670d28 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:39.957198 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fa09d5c0-8fed-455b-8b07-54d375670d28 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:40.058557 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8b2b0fdc-ce20-4b39-933d-85e7d090fbbb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:40.062151 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8b2b0fdc-ce20-4b39-933d-85e7d090fbbb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:40.066561 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8b2b0fdc-ce20-4b39-933d-85e7d090fbbb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:40.067048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8b2b0fdc-ce20-4b39-933d-85e7d090fbbb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:40.067707 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8b2b0fdc-ce20-4b39-933d-85e7d090fbbb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:40.068583 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8b2b0fdc-ce20-4b39-933d-85e7d090fbbb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:40.069026 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8b2b0fdc-ce20-4b39-933d-85e7d090fbbb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:40.069835 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8b2b0fdc-ce20-4b39-933d-85e7d090fbbb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:40.091793 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-fa09d5c0-8fed-455b-8b07-54d375670d28 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:40.099931 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-fa09d5c0-8fed-455b-8b07-54d375670d28 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:40.101452 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-fa09d5c0-8fed-455b-8b07-54d375670d28 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:40.102596 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-fa09d5c0-8fed-455b-8b07-54d375670d28 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.159197 Aug 04 21:41:40.103153 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 129/247] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:39 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:40.152789 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b709d8ed-a296-4959-bd37-984629da05a5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:40.153596 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b709d8ed-a296-4959-bd37-984629da05a5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:40.162091 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b709d8ed-a296-4959-bd37-984629da05a5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:40.162770 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b709d8ed-a296-4959-bd37-984629da05a5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:40.163384 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b709d8ed-a296-4959-bd37-984629da05a5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:40.164236 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b709d8ed-a296-4959-bd37-984629da05a5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:40.164686 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b709d8ed-a296-4959-bd37-984629da05a5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:40.165581 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b709d8ed-a296-4959-bd37-984629da05a5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:40.221613 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8b2b0fdc-ce20-4b39-933d-85e7d090fbbb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:40.229851 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8b2b0fdc-ce20-4b39-933d-85e7d090fbbb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.176337 Aug 04 21:41:40.233903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 119/248] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:40 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:40.313941 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b709d8ed-a296-4959-bd37-984629da05a5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:40.322923 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b709d8ed-a296-4959-bd37-984629da05a5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.176885 Aug 04 21:41:40.334354 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 130/249] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:40 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:41.124981 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-08c4e192-42bf-4848-b52c-eca0a66922cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:41.125592 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-08c4e192-42bf-4848-b52c-eca0a66922cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:41.131641 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c4e192-42bf-4848-b52c-eca0a66922cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:41.132120 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c4e192-42bf-4848-b52c-eca0a66922cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:41.132550 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c4e192-42bf-4848-b52c-eca0a66922cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:41.133232 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c4e192-42bf-4848-b52c-eca0a66922cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:41.133679 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c4e192-42bf-4848-b52c-eca0a66922cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:41.134279 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c4e192-42bf-4848-b52c-eca0a66922cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:41.252916 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-8be0aed7-3a88-4650-9d3a-fb8b752e9637 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:41.253536 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-8be0aed7-3a88-4650-9d3a-fb8b752e9637 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:41.261158 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8be0aed7-3a88-4650-9d3a-fb8b752e9637 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:41.261701 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8be0aed7-3a88-4650-9d3a-fb8b752e9637 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:41.262171 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8be0aed7-3a88-4650-9d3a-fb8b752e9637 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:41.262872 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8be0aed7-3a88-4650-9d3a-fb8b752e9637 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:41.263322 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8be0aed7-3a88-4650-9d3a-fb8b752e9637 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:41.264831 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8be0aed7-3a88-4650-9d3a-fb8b752e9637 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:41.269577 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-08c4e192-42bf-4848-b52c-eca0a66922cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:41.278394 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-08c4e192-42bf-4848-b52c-eca0a66922cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:41.279985 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-08c4e192-42bf-4848-b52c-eca0a66922cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:41.281185 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-08c4e192-42bf-4848-b52c-eca0a66922cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.160274 Aug 04 21:41:41.281816 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 120/250] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:41 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:41.345320 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-39b78497-113c-41c1-8b27-d60dbc4ac1e7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:41.345922 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-39b78497-113c-41c1-8b27-d60dbc4ac1e7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:41.351908 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-39b78497-113c-41c1-8b27-d60dbc4ac1e7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:41.352601 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-39b78497-113c-41c1-8b27-d60dbc4ac1e7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:41.353181 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-39b78497-113c-41c1-8b27-d60dbc4ac1e7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:41.354596 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-39b78497-113c-41c1-8b27-d60dbc4ac1e7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:41.355054 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-39b78497-113c-41c1-8b27-d60dbc4ac1e7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:41.355475 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-39b78497-113c-41c1-8b27-d60dbc4ac1e7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:41.398963 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8be0aed7-3a88-4650-9d3a-fb8b752e9637 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:41.406463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-8be0aed7-3a88-4650-9d3a-fb8b752e9637 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.158823 Aug 04 21:41:41.407034 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 131/251] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:41 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:41.488054 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-39b78497-113c-41c1-8b27-d60dbc4ac1e7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:41.495910 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-39b78497-113c-41c1-8b27-d60dbc4ac1e7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.154540 Aug 04 21:41:41.496471 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 121/252] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:41 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:42.304598 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-4da0c3b6-f700-4027-8ab6-5dc27735d4de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:42.305440 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-4da0c3b6-f700-4027-8ab6-5dc27735d4de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:42.312462 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4da0c3b6-f700-4027-8ab6-5dc27735d4de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:42.312941 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4da0c3b6-f700-4027-8ab6-5dc27735d4de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:42.313366 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4da0c3b6-f700-4027-8ab6-5dc27735d4de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:42.314118 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4da0c3b6-f700-4027-8ab6-5dc27735d4de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:42.314560 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4da0c3b6-f700-4027-8ab6-5dc27735d4de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:42.315001 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4da0c3b6-f700-4027-8ab6-5dc27735d4de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:42.427142 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a400dc76-331f-4102-81bc-f67bbfdb9ff4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:42.427755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-a400dc76-331f-4102-81bc-f67bbfdb9ff4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:42.434630 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a400dc76-331f-4102-81bc-f67bbfdb9ff4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:42.435117 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a400dc76-331f-4102-81bc-f67bbfdb9ff4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:42.435551 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a400dc76-331f-4102-81bc-f67bbfdb9ff4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:42.436245 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a400dc76-331f-4102-81bc-f67bbfdb9ff4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:42.436702 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a400dc76-331f-4102-81bc-f67bbfdb9ff4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:42.437125 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a400dc76-331f-4102-81bc-f67bbfdb9ff4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:42.446688 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4da0c3b6-f700-4027-8ab6-5dc27735d4de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:42.454968 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4da0c3b6-f700-4027-8ab6-5dc27735d4de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:42.456515 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4da0c3b6-f700-4027-8ab6-5dc27735d4de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:42.457648 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-4da0c3b6-f700-4027-8ab6-5dc27735d4de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.156963 Aug 04 21:41:42.458240 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 132/253] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:42 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:42.516503 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e3741f65-e42b-4426-a88a-c7f7eb4a4769 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:42.517021 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e3741f65-e42b-4426-a88a-c7f7eb4a4769 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:42.523138 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e3741f65-e42b-4426-a88a-c7f7eb4a4769 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:42.523921 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e3741f65-e42b-4426-a88a-c7f7eb4a4769 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:42.524028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e3741f65-e42b-4426-a88a-c7f7eb4a4769 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:42.524769 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e3741f65-e42b-4426-a88a-c7f7eb4a4769 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:42.525250 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e3741f65-e42b-4426-a88a-c7f7eb4a4769 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:42.525621 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e3741f65-e42b-4426-a88a-c7f7eb4a4769 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:42.580211 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-a400dc76-331f-4102-81bc-f67bbfdb9ff4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:42.587628 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-a400dc76-331f-4102-81bc-f67bbfdb9ff4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.164390 Aug 04 21:41:42.588187 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 122/254] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:42 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:42.659861 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e3741f65-e42b-4426-a88a-c7f7eb4a4769 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:42.668396 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e3741f65-e42b-4426-a88a-c7f7eb4a4769 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.155086 Aug 04 21:41:42.669040 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 133/255] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:42 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:43.092631 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-97deb61a-128b-45ea-9fce-eb2952a871a5 req-790423a0-2f3b-4f6e-ba5f-a2b616c02b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87934a42-5a51-4ba4-81ed-d07b785bc090", "name": "network-vif-plugged", "status": "completed", "tag": "970090cc-8601-489b-8105-e93f171c77d4"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:41:43.102333 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-97deb61a-128b-45ea-9fce-eb2952a871a5 req-790423a0-2f3b-4f6e-ba5f-a2b616c02b88 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:43.102885 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-97deb61a-128b-45ea-9fce-eb2952a871a5 req-790423a0-2f3b-4f6e-ba5f-a2b616c02b88 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:43.103319 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-97deb61a-128b-45ea-9fce-eb2952a871a5 req-790423a0-2f3b-4f6e-ba5f-a2b616c02b88 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:43.114960 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-97deb61a-128b-45ea-9fce-eb2952a871a5 req-790423a0-2f3b-4f6e-ba5f-a2b616c02b88 service nova] Creating event network-vif-plugged:970090cc-8601-489b-8105-e93f171c77d4 for instance 87934a42-5a51-4ba4-81ed-d07b785bc090 on hv-cinder-85220 Aug 04 21:41:43.120375 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-97deb61a-128b-45ea-9fce-eb2952a871a5 req-790423a0-2f3b-4f6e-ba5f-a2b616c02b88 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031489 Aug 04 21:41:43.122000 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 123/256] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:41:43.480811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-1ba9fc1f-c771-4518-a34c-ba9e42911bd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:43.481414 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-1ba9fc1f-c771-4518-a34c-ba9e42911bd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:43.487372 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1ba9fc1f-c771-4518-a34c-ba9e42911bd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:43.487905 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1ba9fc1f-c771-4518-a34c-ba9e42911bd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:43.488393 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1ba9fc1f-c771-4518-a34c-ba9e42911bd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:43.489104 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1ba9fc1f-c771-4518-a34c-ba9e42911bd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:43.489550 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1ba9fc1f-c771-4518-a34c-ba9e42911bd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:43.489969 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1ba9fc1f-c771-4518-a34c-ba9e42911bd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:43.609187 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-aed3e412-6b11-49ce-a885-ac70893a37b2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:43.609879 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-aed3e412-6b11-49ce-a885-ac70893a37b2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:43.616057 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aed3e412-6b11-49ce-a885-ac70893a37b2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:43.616451 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aed3e412-6b11-49ce-a885-ac70893a37b2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:43.616875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aed3e412-6b11-49ce-a885-ac70893a37b2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:43.617844 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aed3e412-6b11-49ce-a885-ac70893a37b2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:43.618347 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aed3e412-6b11-49ce-a885-ac70893a37b2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:43.618764 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aed3e412-6b11-49ce-a885-ac70893a37b2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:43.618933 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-1ba9fc1f-c771-4518-a34c-ba9e42911bd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:43.627479 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-1ba9fc1f-c771-4518-a34c-ba9e42911bd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:43.629015 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-1ba9fc1f-c771-4518-a34c-ba9e42911bd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:43.630155 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-1ba9fc1f-c771-4518-a34c-ba9e42911bd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.153965 Aug 04 21:41:43.630712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 134/257] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:43 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:43.688988 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-6589250e-d3c9-48dd-9cf6-96732b0fd43f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:43.689659 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-6589250e-d3c9-48dd-9cf6-96732b0fd43f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:43.695632 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6589250e-d3c9-48dd-9cf6-96732b0fd43f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:43.696117 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6589250e-d3c9-48dd-9cf6-96732b0fd43f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:43.696908 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6589250e-d3c9-48dd-9cf6-96732b0fd43f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:43.697224 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6589250e-d3c9-48dd-9cf6-96732b0fd43f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:43.697678 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6589250e-d3c9-48dd-9cf6-96732b0fd43f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:43.699591 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6589250e-d3c9-48dd-9cf6-96732b0fd43f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:43.752107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-aed3e412-6b11-49ce-a885-ac70893a37b2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:43.759739 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-aed3e412-6b11-49ce-a885-ac70893a37b2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.155463 Aug 04 21:41:43.763648 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 124/258] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:43 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:43.834812 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6589250e-d3c9-48dd-9cf6-96732b0fd43f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:43.842674 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-6589250e-d3c9-48dd-9cf6-96732b0fd43f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.157662 Aug 04 21:41:43.844055 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 135/259] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:43 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:44.653246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2390c170-feec-4b68-9eb1-649a89026aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:44.653993 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2390c170-feec-4b68-9eb1-649a89026aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:44.661654 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2390c170-feec-4b68-9eb1-649a89026aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:44.663082 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2390c170-feec-4b68-9eb1-649a89026aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:44.663082 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2390c170-feec-4b68-9eb1-649a89026aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:44.663285 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2390c170-feec-4b68-9eb1-649a89026aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:44.663671 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2390c170-feec-4b68-9eb1-649a89026aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:44.664084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2390c170-feec-4b68-9eb1-649a89026aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:44.780908 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-59b44335-287a-4c6f-9ac9-0fe09372cee5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:44.781497 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-59b44335-287a-4c6f-9ac9-0fe09372cee5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:44.787482 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-59b44335-287a-4c6f-9ac9-0fe09372cee5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:44.787966 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-59b44335-287a-4c6f-9ac9-0fe09372cee5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:44.788403 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-59b44335-287a-4c6f-9ac9-0fe09372cee5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:44.789088 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-59b44335-287a-4c6f-9ac9-0fe09372cee5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:44.789544 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-59b44335-287a-4c6f-9ac9-0fe09372cee5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:44.789965 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-59b44335-287a-4c6f-9ac9-0fe09372cee5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:44.800333 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2390c170-feec-4b68-9eb1-649a89026aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:44.809239 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2390c170-feec-4b68-9eb1-649a89026aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:44.810790 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2390c170-feec-4b68-9eb1-649a89026aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:44.811886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2390c170-feec-4b68-9eb1-649a89026aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.163126 Aug 04 21:41:44.812433 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 125/260] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:44 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:44.864049 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-232a4b25-2026-4d20-b1bf-495f3af333e7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:44.864657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-232a4b25-2026-4d20-b1bf-495f3af333e7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:44.871053 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-232a4b25-2026-4d20-b1bf-495f3af333e7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:44.871555 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-232a4b25-2026-4d20-b1bf-495f3af333e7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:44.871995 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-232a4b25-2026-4d20-b1bf-495f3af333e7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:44.872694 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-232a4b25-2026-4d20-b1bf-495f3af333e7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:44.873141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-232a4b25-2026-4d20-b1bf-495f3af333e7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:44.873567 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-232a4b25-2026-4d20-b1bf-495f3af333e7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:44.926691 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-59b44335-287a-4c6f-9ac9-0fe09372cee5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:44.934244 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-59b44335-287a-4c6f-9ac9-0fe09372cee5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.157306 Aug 04 21:41:44.934818 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 136/261] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:44 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:45.006755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-232a4b25-2026-4d20-b1bf-495f3af333e7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:45.010204 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=100 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:41:45.014466 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-232a4b25-2026-4d20-b1bf-495f3af333e7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.154683 Aug 04 21:41:45.015024 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 126/262] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:44 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:45.836823 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f17b5932-0ba1-4a6c-ad8e-9274d53a2805 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:45.837366 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-f17b5932-0ba1-4a6c-ad8e-9274d53a2805 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:45.839849 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=99 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:41:45.844618 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f17b5932-0ba1-4a6c-ad8e-9274d53a2805 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:45.845097 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f17b5932-0ba1-4a6c-ad8e-9274d53a2805 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:45.845525 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f17b5932-0ba1-4a6c-ad8e-9274d53a2805 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:45.846333 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f17b5932-0ba1-4a6c-ad8e-9274d53a2805 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:45.846798 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f17b5932-0ba1-4a6c-ad8e-9274d53a2805 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:45.847212 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f17b5932-0ba1-4a6c-ad8e-9274d53a2805 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:45.956561 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4c7842e6-9d2d-4e03-827c-390489c70383 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:45.957269 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4c7842e6-9d2d-4e03-827c-390489c70383 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:45.966215 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c7842e6-9d2d-4e03-827c-390489c70383 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:45.966802 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c7842e6-9d2d-4e03-827c-390489c70383 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:45.967310 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c7842e6-9d2d-4e03-827c-390489c70383 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:45.968113 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c7842e6-9d2d-4e03-827c-390489c70383 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:45.968636 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c7842e6-9d2d-4e03-827c-390489c70383 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:45.969302 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c7842e6-9d2d-4e03-827c-390489c70383 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:45.998886 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f17b5932-0ba1-4a6c-ad8e-9274d53a2805 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:46.007662 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f17b5932-0ba1-4a6c-ad8e-9274d53a2805 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:46.009218 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f17b5932-0ba1-4a6c-ad8e-9274d53a2805 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:46.010380 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f17b5932-0ba1-4a6c-ad8e-9274d53a2805 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.177715 Aug 04 21:41:46.010947 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 137/263] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:45 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:46.037522 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-6b67cbf8-38a3-4b24-b48e-0ba50d6b3e7f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:46.038157 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-6b67cbf8-38a3-4b24-b48e-0ba50d6b3e7f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:46.045167 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6b67cbf8-38a3-4b24-b48e-0ba50d6b3e7f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:46.045827 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6b67cbf8-38a3-4b24-b48e-0ba50d6b3e7f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:46.046456 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6b67cbf8-38a3-4b24-b48e-0ba50d6b3e7f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:46.047562 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6b67cbf8-38a3-4b24-b48e-0ba50d6b3e7f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:46.048283 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6b67cbf8-38a3-4b24-b48e-0ba50d6b3e7f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:46.049016 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6b67cbf8-38a3-4b24-b48e-0ba50d6b3e7f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:46.146211 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4c7842e6-9d2d-4e03-827c-390489c70383 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:46.157670 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4c7842e6-9d2d-4e03-827c-390489c70383 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.206054 Aug 04 21:41:46.158946 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 127/264] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:45 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:46.229254 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6b67cbf8-38a3-4b24-b48e-0ba50d6b3e7f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:46.237712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-6b67cbf8-38a3-4b24-b48e-0ba50d6b3e7f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.203979 Aug 04 21:41:46.238330 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 138/265] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:46 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:47.033667 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d3c57443-0fc0-403f-a4df-a434d8684baf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:47.034228 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d3c57443-0fc0-403f-a4df-a434d8684baf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:47.040164 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d3c57443-0fc0-403f-a4df-a434d8684baf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:47.040643 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d3c57443-0fc0-403f-a4df-a434d8684baf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:47.041071 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d3c57443-0fc0-403f-a4df-a434d8684baf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:47.041763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d3c57443-0fc0-403f-a4df-a434d8684baf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:47.042250 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d3c57443-0fc0-403f-a4df-a434d8684baf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:47.042988 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d3c57443-0fc0-403f-a4df-a434d8684baf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:47.173999 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d3c57443-0fc0-403f-a4df-a434d8684baf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:47.180470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-fdc6cbc9-7696-4587-8cde-00faed37b7e7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:47.181109 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-fdc6cbc9-7696-4587-8cde-00faed37b7e7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:47.182255 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d3c57443-0fc0-403f-a4df-a434d8684baf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:47.184269 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d3c57443-0fc0-403f-a4df-a434d8684baf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:47.185377 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d3c57443-0fc0-403f-a4df-a434d8684baf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.155668 Aug 04 21:41:47.185927 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 128/266] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:47 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:41:47.188168 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fdc6cbc9-7696-4587-8cde-00faed37b7e7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:47.188797 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fdc6cbc9-7696-4587-8cde-00faed37b7e7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:47.189315 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fdc6cbc9-7696-4587-8cde-00faed37b7e7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:47.190120 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fdc6cbc9-7696-4587-8cde-00faed37b7e7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:47.190719 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fdc6cbc9-7696-4587-8cde-00faed37b7e7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:47.191245 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fdc6cbc9-7696-4587-8cde-00faed37b7e7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:47.265177 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-5d828a4b-b74b-44ff-bff9-f0d3d56ac861 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:47.265894 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-5d828a4b-b74b-44ff-bff9-f0d3d56ac861 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:47.273732 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5d828a4b-b74b-44ff-bff9-f0d3d56ac861 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:47.279145 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5d828a4b-b74b-44ff-bff9-f0d3d56ac861 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:47.279145 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5d828a4b-b74b-44ff-bff9-f0d3d56ac861 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:47.279145 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5d828a4b-b74b-44ff-bff9-f0d3d56ac861 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:47.279145 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5d828a4b-b74b-44ff-bff9-f0d3d56ac861 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:47.279717 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5d828a4b-b74b-44ff-bff9-f0d3d56ac861 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:47.370303 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-fdc6cbc9-7696-4587-8cde-00faed37b7e7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:47.378596 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-fdc6cbc9-7696-4587-8cde-00faed37b7e7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.201882 Aug 04 21:41:47.379177 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 139/267] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:47 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:47.429028 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-5d828a4b-b74b-44ff-bff9-f0d3d56ac861 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:47.441481 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-5d828a4b-b74b-44ff-bff9-f0d3d56ac861 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.183854 Aug 04 21:41:47.442494 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 129/268] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:47 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:48.208430 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-681a672c-9ee2-4b51-a59c-4e24341262ec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:48.209004 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-681a672c-9ee2-4b51-a59c-4e24341262ec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:48.215272 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-681a672c-9ee2-4b51-a59c-4e24341262ec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:48.215747 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-681a672c-9ee2-4b51-a59c-4e24341262ec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:48.216198 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-681a672c-9ee2-4b51-a59c-4e24341262ec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:48.216873 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-681a672c-9ee2-4b51-a59c-4e24341262ec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:48.217313 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-681a672c-9ee2-4b51-a59c-4e24341262ec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:48.217726 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-681a672c-9ee2-4b51-a59c-4e24341262ec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:48.359407 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-681a672c-9ee2-4b51-a59c-4e24341262ec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:48.367959 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-681a672c-9ee2-4b51-a59c-4e24341262ec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:48.369714 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-681a672c-9ee2-4b51-a59c-4e24341262ec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:48.371456 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-681a672c-9ee2-4b51-a59c-4e24341262ec tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.166386 Aug 04 21:41:48.373756 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 140/269] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:48 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:48.399635 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-cbb5c8ac-0ae5-4465-8121-68dfbaa8d26a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:48.400238 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-cbb5c8ac-0ae5-4465-8121-68dfbaa8d26a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:48.406434 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cbb5c8ac-0ae5-4465-8121-68dfbaa8d26a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:48.408598 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cbb5c8ac-0ae5-4465-8121-68dfbaa8d26a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:48.408598 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cbb5c8ac-0ae5-4465-8121-68dfbaa8d26a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:48.408598 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cbb5c8ac-0ae5-4465-8121-68dfbaa8d26a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:48.408598 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cbb5c8ac-0ae5-4465-8121-68dfbaa8d26a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:48.409108 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cbb5c8ac-0ae5-4465-8121-68dfbaa8d26a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:48.475177 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-be35bf8c-6dc6-4e25-9b9a-f73eca4310c2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:48.475708 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-be35bf8c-6dc6-4e25-9b9a-f73eca4310c2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:48.482458 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-be35bf8c-6dc6-4e25-9b9a-f73eca4310c2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:48.482938 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-be35bf8c-6dc6-4e25-9b9a-f73eca4310c2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:48.483361 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-be35bf8c-6dc6-4e25-9b9a-f73eca4310c2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:48.484047 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-be35bf8c-6dc6-4e25-9b9a-f73eca4310c2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:48.484767 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-be35bf8c-6dc6-4e25-9b9a-f73eca4310c2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:48.485191 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-be35bf8c-6dc6-4e25-9b9a-f73eca4310c2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:48.575801 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-cbb5c8ac-0ae5-4465-8121-68dfbaa8d26a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:48.583327 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-cbb5c8ac-0ae5-4465-8121-68dfbaa8d26a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1322 microversion: 2.1 time: 0.187501 Aug 04 21:41:48.583894 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 130/270] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:48 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:48.649886 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-be35bf8c-6dc6-4e25-9b9a-f73eca4310c2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:48.659208 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-be35bf8c-6dc6-4e25-9b9a-f73eca4310c2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.188176 Aug 04 21:41:48.660137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 141/271] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:48 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:49.400806 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-c85bc8ae-b2dd-494a-894b-b18a1bb1860a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:49.401210 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-c85bc8ae-b2dd-494a-894b-b18a1bb1860a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:49.408273 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c85bc8ae-b2dd-494a-894b-b18a1bb1860a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:49.408761 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c85bc8ae-b2dd-494a-894b-b18a1bb1860a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:49.409190 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c85bc8ae-b2dd-494a-894b-b18a1bb1860a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:49.410227 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c85bc8ae-b2dd-494a-894b-b18a1bb1860a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:49.410681 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c85bc8ae-b2dd-494a-894b-b18a1bb1860a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:49.411103 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c85bc8ae-b2dd-494a-894b-b18a1bb1860a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:49.568134 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-c85bc8ae-b2dd-494a-894b-b18a1bb1860a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:49.577032 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-c85bc8ae-b2dd-494a-894b-b18a1bb1860a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:49.578575 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-c85bc8ae-b2dd-494a-894b-b18a1bb1860a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:49.579673 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-c85bc8ae-b2dd-494a-894b-b18a1bb1860a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.183189 Aug 04 21:41:49.580227 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 131/272] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:49 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:41:49.605543 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-42edfedf-d005-484f-b030-47a0f7d5e55e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:49.606448 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-42edfedf-d005-484f-b030-47a0f7d5e55e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:49.612434 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-42edfedf-d005-484f-b030-47a0f7d5e55e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:49.612910 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-42edfedf-d005-484f-b030-47a0f7d5e55e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:49.613335 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-42edfedf-d005-484f-b030-47a0f7d5e55e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:49.614036 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-42edfedf-d005-484f-b030-47a0f7d5e55e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:49.614482 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-42edfedf-d005-484f-b030-47a0f7d5e55e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:49.614893 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-42edfedf-d005-484f-b030-47a0f7d5e55e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:49.684530 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-fffaf2df-950f-4189-8f6b-90df5ce48fd5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:49.685692 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-fffaf2df-950f-4189-8f6b-90df5ce48fd5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:49.693465 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fffaf2df-950f-4189-8f6b-90df5ce48fd5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:49.694281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fffaf2df-950f-4189-8f6b-90df5ce48fd5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:49.695006 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fffaf2df-950f-4189-8f6b-90df5ce48fd5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:49.696194 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fffaf2df-950f-4189-8f6b-90df5ce48fd5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:49.696803 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fffaf2df-950f-4189-8f6b-90df5ce48fd5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:49.697315 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fffaf2df-950f-4189-8f6b-90df5ce48fd5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:49.775774 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-42edfedf-d005-484f-b030-47a0f7d5e55e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:49.790523 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-42edfedf-d005-484f-b030-47a0f7d5e55e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1517 microversion: 2.1 time: 0.189050 Aug 04 21:41:49.791920 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 142/273] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:49 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1517 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:49.819058 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-3c492498-afeb-4b53-8d4d-229d2a14a932 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:41:49.822409 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-3c492498-afeb-4b53-8d4d-229d2a14a932 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:49.831941 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3c492498-afeb-4b53-8d4d-229d2a14a932 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:49.832766 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3c492498-afeb-4b53-8d4d-229d2a14a932 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:49.833418 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3c492498-afeb-4b53-8d4d-229d2a14a932 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:49.834350 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3c492498-afeb-4b53-8d4d-229d2a14a932 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:49.835052 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3c492498-afeb-4b53-8d4d-229d2a14a932 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:49.835906 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3c492498-afeb-4b53-8d4d-229d2a14a932 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:49.880167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-fffaf2df-950f-4189-8f6b-90df5ce48fd5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:49.888745 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-fffaf2df-950f-4189-8f6b-90df5ce48fd5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1362 microversion: 2.1 time: 0.211884 Aug 04 21:41:49.889316 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 132/274] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:49 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:49.907915 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.objects.instance [None req-3c492498-afeb-4b53-8d4d-229d2a14a932 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lazy-loading 'flavor' on Instance uuid 9770e069-e3a5-4f2e-95a2-8308c2580ec7 {{(pid=136341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:41:50.089781 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:41:50.344907 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-3c492498-afeb-4b53-8d4d-229d2a14a932 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "POST /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7/action" status: 200 len: 32 microversion: 2.1 time: 0.530710 Aug 04 21:41:50.345512 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 143/275] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 4 21:41:49 2022] POST /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7/action => generated 32 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:41:50.359234 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-df6791fb-f3f0-496c-a03c-955448fde92b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:50.360271 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-df6791fb-f3f0-496c-a03c-955448fde92b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:50.369542 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-df6791fb-f3f0-496c-a03c-955448fde92b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:50.371616 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-df6791fb-f3f0-496c-a03c-955448fde92b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:50.372741 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-df6791fb-f3f0-496c-a03c-955448fde92b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:50.373158 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-df6791fb-f3f0-496c-a03c-955448fde92b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:50.373721 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-df6791fb-f3f0-496c-a03c-955448fde92b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:50.374275 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-df6791fb-f3f0-496c-a03c-955448fde92b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:50.560190 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-9cc1a8d6-0095-450a-afd1-d1bb4f5208ea tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "942b7e55-a546-49e9-88a7-703cc49a6d16"}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:41:50.562799 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-df6791fb-f3f0-496c-a03c-955448fde92b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:50.563491 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-9cc1a8d6-0095-450a-afd1-d1bb4f5208ea tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:50.570133 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9cc1a8d6-0095-450a-afd1-d1bb4f5208ea tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:50.570619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9cc1a8d6-0095-450a-afd1-d1bb4f5208ea tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:50.571052 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9cc1a8d6-0095-450a-afd1-d1bb4f5208ea tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:50.571497 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-df6791fb-f3f0-496c-a03c-955448fde92b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.219937 Aug 04 21:41:50.571740 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9cc1a8d6-0095-450a-afd1-d1bb4f5208ea tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:50.572072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 133/276] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:50 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:50.572232 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9cc1a8d6-0095-450a-afd1-d1bb4f5208ea tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:50.572677 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9cc1a8d6-0095-450a-afd1-d1bb4f5208ea tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:50.609597 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-15fb57d9-482f-4012-bc96-94d871f8c86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:50.610711 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-15fb57d9-482f-4012-bc96-94d871f8c86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:50.618673 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-15fb57d9-482f-4012-bc96-94d871f8c86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:50.619157 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-15fb57d9-482f-4012-bc96-94d871f8c86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:50.619591 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-15fb57d9-482f-4012-bc96-94d871f8c86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:50.620282 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-15fb57d9-482f-4012-bc96-94d871f8c86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:50.621053 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-15fb57d9-482f-4012-bc96-94d871f8c86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:50.621238 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-15fb57d9-482f-4012-bc96-94d871f8c86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:50.778749 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-15fb57d9-482f-4012-bc96-94d871f8c86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:50.787005 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-15fb57d9-482f-4012-bc96-94d871f8c86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:50.788542 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-15fb57d9-482f-4012-bc96-94d871f8c86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:50.792982 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-15fb57d9-482f-4012-bc96-94d871f8c86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.184716 Aug 04 21:41:50.792982 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 134/277] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:50 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:41:50.795610 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4e562dae-b27b-4be1-b2a4-84184ed7e1d3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-96279105", "imageRef": "fca0c9ba-fb0a-4f30-932f-84d5253674ad", "flavorRef": "452", "networks": [{"uuid": "0a5dd67a-0f5d-448f-908c-876c4f749a33"}]}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:41:50.851482 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.network.neutron [None req-4e562dae-b27b-4be1-b2a4-84184ed7e1d3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] validate_networks() for [('0a5dd67a-0f5d-448f-908c-876c4f749a33', None, None, None, None, None)] {{(pid=136342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:41:51.231532 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-4e562dae-b27b-4be1-b2a4-84184ed7e1d3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Flavor limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:41:51.231881 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-4e562dae-b27b-4be1-b2a4-84184ed7e1d3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Image limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:41:51.232434 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-4e562dae-b27b-4be1-b2a4-84184ed7e1d3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Flavor pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:41:51.232824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-4e562dae-b27b-4be1-b2a4-84184ed7e1d3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Image pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:41:51.233235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-4e562dae-b27b-4be1-b2a4-84184ed7e1d3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:41:51.246431 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4e562dae-b27b-4be1-b2a4-84184ed7e1d3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:51.247325 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4e562dae-b27b-4be1-b2a4-84184ed7e1d3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:51.248101 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4e562dae-b27b-4be1-b2a4-84184ed7e1d3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:51.249401 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4e562dae-b27b-4be1-b2a4-84184ed7e1d3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:51.250346 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4e562dae-b27b-4be1-b2a4-84184ed7e1d3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:51.251070 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4e562dae-b27b-4be1-b2a4-84184ed7e1d3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:51.270469 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-4e562dae-b27b-4be1-b2a4-84184ed7e1d3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Getting quotas for project b37a8c7b37ac4f8d9711ac8cd0e37f02. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:41:51.276029 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-4e562dae-b27b-4be1-b2a4-84184ed7e1d3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Getting quotas for user db4a45e9f40740c99cc49d9f2978332d and project b37a8c7b37ac4f8d9711ac8cd0e37f02. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:41:51.290734 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=100 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:41:51.298817 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4e562dae-b27b-4be1-b2a4-84184ed7e1d3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Going to run 1 instances... {{(pid=136342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:41:51.302218 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4e562dae-b27b-4be1-b2a4-84184ed7e1d3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca0c9ba-fb0a-4f30-932f-84d5253674ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:41:51.482347 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4e562dae-b27b-4be1-b2a4-84184ed7e1d3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690960 Aug 04 21:41:51.483023 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 135/278] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 4 21:41:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:41:51.487528 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8ccd2ac1-5dea-4d9e-a1b7-12300f0efdfd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:51.488161 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8ccd2ac1-5dea-4d9e-a1b7-12300f0efdfd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:51.499094 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8ccd2ac1-5dea-4d9e-a1b7-12300f0efdfd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:51.499746 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8ccd2ac1-5dea-4d9e-a1b7-12300f0efdfd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:51.500290 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8ccd2ac1-5dea-4d9e-a1b7-12300f0efdfd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:51.501229 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8ccd2ac1-5dea-4d9e-a1b7-12300f0efdfd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:51.501878 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8ccd2ac1-5dea-4d9e-a1b7-12300f0efdfd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:51.502556 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8ccd2ac1-5dea-4d9e-a1b7-12300f0efdfd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:51.696249 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8ccd2ac1-5dea-4d9e-a1b7-12300f0efdfd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:51.704655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8ccd2ac1-5dea-4d9e-a1b7-12300f0efdfd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1547 microversion: 2.1 time: 0.220626 Aug 04 21:41:51.705227 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 136/279] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:51 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1547 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:51.709808 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8a2ef9eb-8438-465f-8095-d9ed3a3c1dd1 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:51.710441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8a2ef9eb-8438-465f-8095-d9ed3a3c1dd1 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:51.765242 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8a2ef9eb-8438-465f-8095-d9ed3a3c1dd1 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:51.772469 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8a2ef9eb-8438-465f-8095-d9ed3a3c1dd1 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1212 microversion: 2.1 time: 0.066272 Aug 04 21:41:51.775208 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 137/280] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:51 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1212 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:51.777928 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-12e53620-e62e-4f64-bac3-c9a420b402b8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:51.778551 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-12e53620-e62e-4f64-bac3-c9a420b402b8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:51.784523 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-12e53620-e62e-4f64-bac3-c9a420b402b8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:51.785118 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-12e53620-e62e-4f64-bac3-c9a420b402b8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:51.785541 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-12e53620-e62e-4f64-bac3-c9a420b402b8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:51.786557 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-12e53620-e62e-4f64-bac3-c9a420b402b8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:51.787110 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-12e53620-e62e-4f64-bac3-c9a420b402b8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:51.787532 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-12e53620-e62e-4f64-bac3-c9a420b402b8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:51.934051 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-12e53620-e62e-4f64-bac3-c9a420b402b8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:51.941654 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-12e53620-e62e-4f64-bac3-c9a420b402b8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.167655 Aug 04 21:41:51.942243 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 138/281] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:51 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:51.946767 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8240f1a7-13d7-464f-9357-1644b439516c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:51.947242 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8240f1a7-13d7-464f-9357-1644b439516c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:51.953879 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8240f1a7-13d7-464f-9357-1644b439516c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:51.954386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8240f1a7-13d7-464f-9357-1644b439516c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:51.954815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8240f1a7-13d7-464f-9357-1644b439516c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:51.955516 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8240f1a7-13d7-464f-9357-1644b439516c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:51.955957 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8240f1a7-13d7-464f-9357-1644b439516c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:51.956369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8240f1a7-13d7-464f-9357-1644b439516c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:52.083286 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8240f1a7-13d7-464f-9357-1644b439516c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139749 Aug 04 21:41:52.084357 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 139/282] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 4 21:41:51 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:41:52.092927 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-aab492db-89eb-4947-ad25-451ea8ce2966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:52.093967 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-aab492db-89eb-4947-ad25-451ea8ce2966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:52.101489 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aab492db-89eb-4947-ad25-451ea8ce2966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:52.102101 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aab492db-89eb-4947-ad25-451ea8ce2966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:52.102530 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aab492db-89eb-4947-ad25-451ea8ce2966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:52.103221 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aab492db-89eb-4947-ad25-451ea8ce2966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:52.103670 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aab492db-89eb-4947-ad25-451ea8ce2966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:52.104082 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aab492db-89eb-4947-ad25-451ea8ce2966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:52.272023 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-aab492db-89eb-4947-ad25-451ea8ce2966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:52.284108 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-aab492db-89eb-4947-ad25-451ea8ce2966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:52.287226 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-aab492db-89eb-4947-ad25-451ea8ce2966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:52.293864 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-aab492db-89eb-4947-ad25-451ea8ce2966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.202847 Aug 04 21:41:52.293864 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 140/283] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:52 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:52.798752 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-916769d5-a7f2-4591-af48-befaf74ed79b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:52.807398 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-916769d5-a7f2-4591-af48-befaf74ed79b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:52.905716 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-916769d5-a7f2-4591-af48-befaf74ed79b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:52.919750 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-916769d5-a7f2-4591-af48-befaf74ed79b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1212 microversion: 2.1 time: 0.124950 Aug 04 21:41:52.935460 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 141/284] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:52 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1212 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:52.967921 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ebdeadba-99e3-4f5f-a3be-fb02fdae64ea tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:52.968692 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ebdeadba-99e3-4f5f-a3be-fb02fdae64ea tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:52.976646 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ebdeadba-99e3-4f5f-a3be-fb02fdae64ea tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:52.977304 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ebdeadba-99e3-4f5f-a3be-fb02fdae64ea tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:52.977911 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ebdeadba-99e3-4f5f-a3be-fb02fdae64ea tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:52.978732 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ebdeadba-99e3-4f5f-a3be-fb02fdae64ea tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:52.979281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ebdeadba-99e3-4f5f-a3be-fb02fdae64ea tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:52.980426 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ebdeadba-99e3-4f5f-a3be-fb02fdae64ea tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:53.543074 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ebdeadba-99e3-4f5f-a3be-fb02fdae64ea tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:53.562142 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ebdeadba-99e3-4f5f-a3be-fb02fdae64ea tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.600557 Aug 04 21:41:53.563870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 142/285] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:52 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:53.578853 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-9cc1a8d6-0095-450a-afd1-d1bb4f5208ea tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "POST /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.023028 Aug 04 21:41:53.580399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 144/286] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 4 21:41:50 2022] POST /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65/os-volume_attachments => generated 194 bytes in 3026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:41:53.585058 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e6cc4779-6d45-47ae-91fd-6b57faf143a8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:53.585058 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e6cc4779-6d45-47ae-91fd-6b57faf143a8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:53.592634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e6cc4779-6d45-47ae-91fd-6b57faf143a8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:53.593436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e6cc4779-6d45-47ae-91fd-6b57faf143a8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:53.595231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e6cc4779-6d45-47ae-91fd-6b57faf143a8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:53.596580 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e6cc4779-6d45-47ae-91fd-6b57faf143a8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:53.597276 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e6cc4779-6d45-47ae-91fd-6b57faf143a8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:53.598640 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e6cc4779-6d45-47ae-91fd-6b57faf143a8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:53.961738 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-5bf9483b-265e-412f-8fdb-ce2ed9004eaa tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:53.963723 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-5bf9483b-265e-412f-8fdb-ce2ed9004eaa tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:53.993868 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5bf9483b-265e-412f-8fdb-ce2ed9004eaa tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:53.997926 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5bf9483b-265e-412f-8fdb-ce2ed9004eaa tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:53.998846 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5bf9483b-265e-412f-8fdb-ce2ed9004eaa tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:54.000257 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5bf9483b-265e-412f-8fdb-ce2ed9004eaa tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:54.004975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5bf9483b-265e-412f-8fdb-ce2ed9004eaa tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:54.005936 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5bf9483b-265e-412f-8fdb-ce2ed9004eaa tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:54.077458 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e6cc4779-6d45-47ae-91fd-6b57faf143a8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:54.088559 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e6cc4779-6d45-47ae-91fd-6b57faf143a8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:54.090751 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e6cc4779-6d45-47ae-91fd-6b57faf143a8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:54.096512 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e6cc4779-6d45-47ae-91fd-6b57faf143a8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.531298 Aug 04 21:41:54.097114 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 143/287] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:53 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:54.124211 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-305d8640-a6ed-44bf-9a99-1ddfcd0ba716 req-b5a8c197-4e9f-4b2c-917b-55e7fc2c17cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbeea630-d67b-4f89-a329-c7066d506126", "tag": "b245eeb4-95cf-45b5-8d69-591f776623e4"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:41:54.132385 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-305d8640-a6ed-44bf-9a99-1ddfcd0ba716 req-b5a8c197-4e9f-4b2c-917b-55e7fc2c17cb service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:54.132885 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-305d8640-a6ed-44bf-9a99-1ddfcd0ba716 req-b5a8c197-4e9f-4b2c-917b-55e7fc2c17cb service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:54.136926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-305d8640-a6ed-44bf-9a99-1ddfcd0ba716 req-b5a8c197-4e9f-4b2c-917b-55e7fc2c17cb service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:54.152588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5bf9483b-265e-412f-8fdb-ce2ed9004eaa tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:54.166069 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-5bf9483b-265e-412f-8fdb-ce2ed9004eaa tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1208 microversion: 2.1 time: 0.218474 Aug 04 21:41:54.179796 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 145/288] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:53 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1208 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:54.186474 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-305d8640-a6ed-44bf-9a99-1ddfcd0ba716 req-b5a8c197-4e9f-4b2c-917b-55e7fc2c17cb service nova] Creating event network-changed:b245eeb4-95cf-45b5-8d69-591f776623e4 for instance dbeea630-d67b-4f89-a329-c7066d506126 on hv-cinder-85220 Aug 04 21:41:54.196337 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-305d8640-a6ed-44bf-9a99-1ddfcd0ba716 req-b5a8c197-4e9f-4b2c-917b-55e7fc2c17cb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095126 Aug 04 21:41:54.197649 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 144/289] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:41:54.605629 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-31f8c86b-52b8-4796-8924-1e03a54a584a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:54.606275 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-31f8c86b-52b8-4796-8924-1e03a54a584a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:54.612460 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-31f8c86b-52b8-4796-8924-1e03a54a584a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:54.612940 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-31f8c86b-52b8-4796-8924-1e03a54a584a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:54.613369 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-31f8c86b-52b8-4796-8924-1e03a54a584a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:54.614079 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-31f8c86b-52b8-4796-8924-1e03a54a584a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:54.614529 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-31f8c86b-52b8-4796-8924-1e03a54a584a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:54.614972 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-31f8c86b-52b8-4796-8924-1e03a54a584a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:54.768806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-31f8c86b-52b8-4796-8924-1e03a54a584a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:54.776694 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-31f8c86b-52b8-4796-8924-1e03a54a584a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.175067 Aug 04 21:41:54.777811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 146/290] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:54 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:55.133632 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-09ca8bc8-b182-45a4-a8f4-07de541cd0b5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:55.134470 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-09ca8bc8-b182-45a4-a8f4-07de541cd0b5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:55.141881 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-09ca8bc8-b182-45a4-a8f4-07de541cd0b5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:55.142488 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-09ca8bc8-b182-45a4-a8f4-07de541cd0b5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:55.142921 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-09ca8bc8-b182-45a4-a8f4-07de541cd0b5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:55.143615 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-09ca8bc8-b182-45a4-a8f4-07de541cd0b5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:55.144066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-09ca8bc8-b182-45a4-a8f4-07de541cd0b5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:55.144488 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-09ca8bc8-b182-45a4-a8f4-07de541cd0b5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:55.189872 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-bafdf476-fb32-4616-b03a-68306292cfa2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:55.190805 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-bafdf476-fb32-4616-b03a-68306292cfa2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:55.204676 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bafdf476-fb32-4616-b03a-68306292cfa2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:55.204676 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bafdf476-fb32-4616-b03a-68306292cfa2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:55.205530 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bafdf476-fb32-4616-b03a-68306292cfa2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:55.206778 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bafdf476-fb32-4616-b03a-68306292cfa2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:55.207860 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bafdf476-fb32-4616-b03a-68306292cfa2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:55.208610 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bafdf476-fb32-4616-b03a-68306292cfa2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:55.282614 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-bafdf476-fb32-4616-b03a-68306292cfa2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:55.301040 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-bafdf476-fb32-4616-b03a-68306292cfa2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1264 microversion: 2.1 time: 0.117704 Aug 04 21:41:55.301610 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 147/291] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:55 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1264 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:55.306906 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-09ca8bc8-b182-45a4-a8f4-07de541cd0b5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:55.317632 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-09ca8bc8-b182-45a4-a8f4-07de541cd0b5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:55.319181 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-09ca8bc8-b182-45a4-a8f4-07de541cd0b5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:55.320251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-09ca8bc8-b182-45a4-a8f4-07de541cd0b5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1406 microversion: 2.20 time: 0.192034 Aug 04 21:41:55.320824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 145/292] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:55 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:41:55.803280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f450ab2f-d9e2-4521-b602-068eb8d52aff tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:55.803811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-f450ab2f-d9e2-4521-b602-068eb8d52aff tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:55.812795 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f450ab2f-d9e2-4521-b602-068eb8d52aff tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:55.813536 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f450ab2f-d9e2-4521-b602-068eb8d52aff tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:55.814494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f450ab2f-d9e2-4521-b602-068eb8d52aff tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:55.815287 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f450ab2f-d9e2-4521-b602-068eb8d52aff tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:55.816054 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f450ab2f-d9e2-4521-b602-068eb8d52aff tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:55.816879 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f450ab2f-d9e2-4521-b602-068eb8d52aff tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:55.990188 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f450ab2f-d9e2-4521-b602-068eb8d52aff tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:55.999622 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f450ab2f-d9e2-4521-b602-068eb8d52aff tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.199999 Aug 04 21:41:56.000198 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 148/293] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:55 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:56.326198 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-24440096-4450-4c51-af07-66f47272d300 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:56.327893 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-24440096-4450-4c51-af07-66f47272d300 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:56.340366 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-24440096-4450-4c51-af07-66f47272d300 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:56.341151 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-24440096-4450-4c51-af07-66f47272d300 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:56.342141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-24440096-4450-4c51-af07-66f47272d300 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:56.343260 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-24440096-4450-4c51-af07-66f47272d300 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:56.343990 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-24440096-4450-4c51-af07-66f47272d300 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:56.344671 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-24440096-4450-4c51-af07-66f47272d300 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:56.348098 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2c4bd8e6-c9b4-4d09-ae56-75d3469c853e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:56.349359 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-2c4bd8e6-c9b4-4d09-ae56-75d3469c853e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:56.361560 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2c4bd8e6-c9b4-4d09-ae56-75d3469c853e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:56.362724 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2c4bd8e6-c9b4-4d09-ae56-75d3469c853e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:56.363646 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2c4bd8e6-c9b4-4d09-ae56-75d3469c853e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:56.365196 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2c4bd8e6-c9b4-4d09-ae56-75d3469c853e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:56.366569 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2c4bd8e6-c9b4-4d09-ae56-75d3469c853e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:56.367488 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2c4bd8e6-c9b4-4d09-ae56-75d3469c853e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:56.443877 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-24440096-4450-4c51-af07-66f47272d300 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:56.452631 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-24440096-4450-4c51-af07-66f47272d300 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1272 microversion: 2.1 time: 0.133209 Aug 04 21:41:56.454135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 146/294] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:56 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1272 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:56.529058 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2c4bd8e6-c9b4-4d09-ae56-75d3469c853e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:56.537289 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2c4bd8e6-c9b4-4d09-ae56-75d3469c853e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:56.538854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2c4bd8e6-c9b4-4d09-ae56-75d3469c853e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:56.540012 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2c4bd8e6-c9b4-4d09-ae56-75d3469c853e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1599 microversion: 2.20 time: 0.198948 Aug 04 21:41:56.540576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 149/295] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:41:56 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1599 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:41:56.568579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e8644997-3d35-4705-accb-61d36874eefc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:56.569062 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e8644997-3d35-4705-accb-61d36874eefc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:56.575141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e8644997-3d35-4705-accb-61d36874eefc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:56.575618 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e8644997-3d35-4705-accb-61d36874eefc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:56.576046 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e8644997-3d35-4705-accb-61d36874eefc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:56.576731 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e8644997-3d35-4705-accb-61d36874eefc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:56.577220 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e8644997-3d35-4705-accb-61d36874eefc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:56.577639 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e8644997-3d35-4705-accb-61d36874eefc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:56.582311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=100 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:41:56.668942 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e8644997-3d35-4705-accb-61d36874eefc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.104175 Aug 04 21:41:56.669789 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 147/296] 10.222.0.73 () {60 vars in 1316 bytes} [Thu Aug 4 21:41:56 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:41:57.027676 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-07ceb64b-c0f6-4762-b7c8-70c64a574442 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:57.030139 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-07ceb64b-c0f6-4762-b7c8-70c64a574442 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:57.045212 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-07ceb64b-c0f6-4762-b7c8-70c64a574442 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:57.046562 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-07ceb64b-c0f6-4762-b7c8-70c64a574442 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:57.047567 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-07ceb64b-c0f6-4762-b7c8-70c64a574442 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:57.048918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-07ceb64b-c0f6-4762-b7c8-70c64a574442 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:57.049938 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-07ceb64b-c0f6-4762-b7c8-70c64a574442 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:57.050972 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-07ceb64b-c0f6-4762-b7c8-70c64a574442 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:57.495024 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6606edec-ece3-4d3e-b270-6a1d72ac5d53 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:57.498356 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-6606edec-ece3-4d3e-b270-6a1d72ac5d53 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:57.550197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6606edec-ece3-4d3e-b270-6a1d72ac5d53 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:57.551192 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6606edec-ece3-4d3e-b270-6a1d72ac5d53 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:57.552815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6606edec-ece3-4d3e-b270-6a1d72ac5d53 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:57.552815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6606edec-ece3-4d3e-b270-6a1d72ac5d53 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:57.553554 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6606edec-ece3-4d3e-b270-6a1d72ac5d53 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:57.554288 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6606edec-ece3-4d3e-b270-6a1d72ac5d53 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:57.663205 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6606edec-ece3-4d3e-b270-6a1d72ac5d53 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:57.672025 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-6606edec-ece3-4d3e-b270-6a1d72ac5d53 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1282 microversion: 2.1 time: 0.195649 Aug 04 21:41:57.672596 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 148/297] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:57 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1282 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:57.752660 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-07ceb64b-c0f6-4762-b7c8-70c64a574442 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:57.763829 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-07ceb64b-c0f6-4762-b7c8-70c64a574442 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.745555 Aug 04 21:41:57.764951 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 150/298] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:57 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:41:58.153082 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-4d8caf74-040f-4bf3-b88c-652993334144 req-6a9500f9-6c3e-444e-b986-e115b637bc9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87934a42-5a51-4ba4-81ed-d07b785bc090", "tag": "970090cc-8601-489b-8105-e93f171c77d4"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:41:58.162792 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-4d8caf74-040f-4bf3-b88c-652993334144 req-6a9500f9-6c3e-444e-b986-e115b637bc9a service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:58.163332 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-4d8caf74-040f-4bf3-b88c-652993334144 req-6a9500f9-6c3e-444e-b986-e115b637bc9a service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:58.163849 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-4d8caf74-040f-4bf3-b88c-652993334144 req-6a9500f9-6c3e-444e-b986-e115b637bc9a service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:58.176058 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-4d8caf74-040f-4bf3-b88c-652993334144 req-6a9500f9-6c3e-444e-b986-e115b637bc9a service nova] Creating event network-changed:970090cc-8601-489b-8105-e93f171c77d4 for instance 87934a42-5a51-4ba4-81ed-d07b785bc090 on hv-cinder-85220 Aug 04 21:41:58.181404 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-4d8caf74-040f-4bf3-b88c-652993334144 req-6a9500f9-6c3e-444e-b986-e115b637bc9a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032390 Aug 04 21:41:58.181992 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 149/299] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:41:58.697831 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-3dcea1ff-4e29-4035-a1e2-3e1b3521833f tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:58.699028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-3dcea1ff-4e29-4035-a1e2-3e1b3521833f tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:58.712885 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3dcea1ff-4e29-4035-a1e2-3e1b3521833f tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:58.714884 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3dcea1ff-4e29-4035-a1e2-3e1b3521833f tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:58.714884 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3dcea1ff-4e29-4035-a1e2-3e1b3521833f tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:58.714884 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3dcea1ff-4e29-4035-a1e2-3e1b3521833f tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:58.715299 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3dcea1ff-4e29-4035-a1e2-3e1b3521833f tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:58.715672 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3dcea1ff-4e29-4035-a1e2-3e1b3521833f tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:58.795104 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-3d90e52f-52b6-4d08-9115-07d78d3028aa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:58.798803 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-3d90e52f-52b6-4d08-9115-07d78d3028aa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:58.810686 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d90e52f-52b6-4d08-9115-07d78d3028aa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:58.811487 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d90e52f-52b6-4d08-9115-07d78d3028aa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:58.812110 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d90e52f-52b6-4d08-9115-07d78d3028aa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:58.814400 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d90e52f-52b6-4d08-9115-07d78d3028aa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:58.817056 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d90e52f-52b6-4d08-9115-07d78d3028aa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:58.819500 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d90e52f-52b6-4d08-9115-07d78d3028aa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:58.915224 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-3dcea1ff-4e29-4035-a1e2-3e1b3521833f tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:58.924499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-3dcea1ff-4e29-4035-a1e2-3e1b3521833f tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1270 microversion: 2.1 time: 0.230609 Aug 04 21:41:58.925647 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 151/300] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:58 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1270 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:59.119786 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-3d90e52f-52b6-4d08-9115-07d78d3028aa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:41:59.133207 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-3d90e52f-52b6-4d08-9115-07d78d3028aa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.348866 Aug 04 21:41:59.147057 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 150/301] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:58 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:41:59.945675 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-1c8f26a7-cfb4-4b8c-ad88-5f419a701d5c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:41:59.946303 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-1c8f26a7-cfb4-4b8c-ad88-5f419a701d5c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:41:59.953226 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1c8f26a7-cfb4-4b8c-ad88-5f419a701d5c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:59.953711 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1c8f26a7-cfb4-4b8c-ad88-5f419a701d5c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:59.954174 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1c8f26a7-cfb4-4b8c-ad88-5f419a701d5c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:41:59.954865 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1c8f26a7-cfb4-4b8c-ad88-5f419a701d5c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:41:59.955312 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1c8f26a7-cfb4-4b8c-ad88-5f419a701d5c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:41:59.955732 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1c8f26a7-cfb4-4b8c-ad88-5f419a701d5c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:00.152388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-1c8f26a7-cfb4-4b8c-ad88-5f419a701d5c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:00.155339 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-dc8fac16-f595-4c19-9aff-65cf8e087617 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:00.156050 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-dc8fac16-f595-4c19-9aff-65cf8e087617 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:00.162076 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-1c8f26a7-cfb4-4b8c-ad88-5f419a701d5c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.220080 Aug 04 21:42:00.162825 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 152/302] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:41:59 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:00.164908 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dc8fac16-f595-4c19-9aff-65cf8e087617 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:00.165389 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dc8fac16-f595-4c19-9aff-65cf8e087617 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:00.165814 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dc8fac16-f595-4c19-9aff-65cf8e087617 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:00.166534 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dc8fac16-f595-4c19-9aff-65cf8e087617 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:00.167041 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dc8fac16-f595-4c19-9aff-65cf8e087617 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:00.168251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dc8fac16-f595-4c19-9aff-65cf8e087617 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:00.306950 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-dc8fac16-f595-4c19-9aff-65cf8e087617 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:00.315072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-dc8fac16-f595-4c19-9aff-65cf8e087617 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.164176 Aug 04 21:42:00.318462 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 151/303] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:00 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:00.531616 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-d1f0abbb-7417-46ac-9a89-a11716d2cdb3 req-c4e1b0f2-d292-4ed1-a20c-d711aa3cc520 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a1d1620-92e5-471d-9845-d3c256391b0b", "tag": "e9fe7799-ea7c-41c5-9742-76dce429671e"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:42:00.541186 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-d1f0abbb-7417-46ac-9a89-a11716d2cdb3 req-c4e1b0f2-d292-4ed1-a20c-d711aa3cc520 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:00.541654 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-d1f0abbb-7417-46ac-9a89-a11716d2cdb3 req-c4e1b0f2-d292-4ed1-a20c-d711aa3cc520 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:00.542316 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-d1f0abbb-7417-46ac-9a89-a11716d2cdb3 req-c4e1b0f2-d292-4ed1-a20c-d711aa3cc520 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:00.692753 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-d1f0abbb-7417-46ac-9a89-a11716d2cdb3 req-c4e1b0f2-d292-4ed1-a20c-d711aa3cc520 service nova] Creating event network-changed:e9fe7799-ea7c-41c5-9742-76dce429671e for instance 8a1d1620-92e5-471d-9845-d3c256391b0b on hv-cinder-85220 Aug 04 21:42:00.697713 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-d1f0abbb-7417-46ac-9a89-a11716d2cdb3 req-c4e1b0f2-d292-4ed1-a20c-d711aa3cc520 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169716 Aug 04 21:42:00.698723 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 153/304] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:42:01.184434 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-34115028-129b-4259-9998-30f189190cbd tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:01.185070 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-34115028-129b-4259-9998-30f189190cbd tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:01.191153 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-34115028-129b-4259-9998-30f189190cbd tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:01.191628 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-34115028-129b-4259-9998-30f189190cbd tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:01.192054 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-34115028-129b-4259-9998-30f189190cbd tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:01.192768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-34115028-129b-4259-9998-30f189190cbd tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:01.193216 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-34115028-129b-4259-9998-30f189190cbd tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:01.193632 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-34115028-129b-4259-9998-30f189190cbd tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:01.260396 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=2 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:42:01.324491 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-34115028-129b-4259-9998-30f189190cbd tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:01.332260 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-34115028-129b-4259-9998-30f189190cbd tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.151864 Aug 04 21:42:01.332894 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 152/305] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:01 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:01.338927 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ee938cda-61ec-4b15-97ac-ee220e6b891e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:01.339813 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ee938cda-61ec-4b15-97ac-ee220e6b891e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:01.346063 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ee938cda-61ec-4b15-97ac-ee220e6b891e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:01.346722 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ee938cda-61ec-4b15-97ac-ee220e6b891e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:01.347148 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ee938cda-61ec-4b15-97ac-ee220e6b891e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:01.347828 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ee938cda-61ec-4b15-97ac-ee220e6b891e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:01.348326 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ee938cda-61ec-4b15-97ac-ee220e6b891e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:01.348739 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ee938cda-61ec-4b15-97ac-ee220e6b891e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:01.481461 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ee938cda-61ec-4b15-97ac-ee220e6b891e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:01.488977 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ee938cda-61ec-4b15-97ac-ee220e6b891e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.155183 Aug 04 21:42:01.489533 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 154/306] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:01 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:02.352908 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6c8f1db2-a298-4983-b84e-4e575a9abb21 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:02.353545 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-6c8f1db2-a298-4983-b84e-4e575a9abb21 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:02.359700 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6c8f1db2-a298-4983-b84e-4e575a9abb21 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:02.360179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6c8f1db2-a298-4983-b84e-4e575a9abb21 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:02.360610 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6c8f1db2-a298-4983-b84e-4e575a9abb21 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:02.361295 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6c8f1db2-a298-4983-b84e-4e575a9abb21 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:02.361849 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6c8f1db2-a298-4983-b84e-4e575a9abb21 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:02.362292 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6c8f1db2-a298-4983-b84e-4e575a9abb21 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:02.495666 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6c8f1db2-a298-4983-b84e-4e575a9abb21 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:02.504343 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-6c8f1db2-a298-4983-b84e-4e575a9abb21 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.155481 Aug 04 21:42:02.504926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 153/307] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:02 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:02.510019 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2f279feb-c6d8-4208-b7c9-1276d49ad0a9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:02.510643 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-2f279feb-c6d8-4208-b7c9-1276d49ad0a9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:02.517933 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f279feb-c6d8-4208-b7c9-1276d49ad0a9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:02.518451 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f279feb-c6d8-4208-b7c9-1276d49ad0a9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:02.523007 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f279feb-c6d8-4208-b7c9-1276d49ad0a9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:02.523007 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f279feb-c6d8-4208-b7c9-1276d49ad0a9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:02.523007 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f279feb-c6d8-4208-b7c9-1276d49ad0a9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:02.523007 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f279feb-c6d8-4208-b7c9-1276d49ad0a9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:02.650042 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2f279feb-c6d8-4208-b7c9-1276d49ad0a9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:02.658470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2f279feb-c6d8-4208-b7c9-1276d49ad0a9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.152196 Aug 04 21:42:02.659034 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 155/308] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:02 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:03.525425 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-46b8eea1-d12a-46a9-826d-1a9fea5607fb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:03.525843 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-46b8eea1-d12a-46a9-826d-1a9fea5607fb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:03.527719 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=10 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:42:03.533623 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-46b8eea1-d12a-46a9-826d-1a9fea5607fb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:03.534197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-46b8eea1-d12a-46a9-826d-1a9fea5607fb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:03.534632 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-46b8eea1-d12a-46a9-826d-1a9fea5607fb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:03.535352 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-46b8eea1-d12a-46a9-826d-1a9fea5607fb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:03.535802 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-46b8eea1-d12a-46a9-826d-1a9fea5607fb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:03.536221 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-46b8eea1-d12a-46a9-826d-1a9fea5607fb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:03.666570 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-46b8eea1-d12a-46a9-826d-1a9fea5607fb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:03.675100 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-46b8eea1-d12a-46a9-826d-1a9fea5607fb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.154312 Aug 04 21:42:03.675651 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 154/309] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:03 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:03.679700 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-0c65a1ae-fb1f-4495-83e6-83b2b14d7c07 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:03.680316 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-0c65a1ae-fb1f-4495-83e6-83b2b14d7c07 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:03.687912 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0c65a1ae-fb1f-4495-83e6-83b2b14d7c07 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:03.688402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0c65a1ae-fb1f-4495-83e6-83b2b14d7c07 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:03.688843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0c65a1ae-fb1f-4495-83e6-83b2b14d7c07 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:03.689539 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0c65a1ae-fb1f-4495-83e6-83b2b14d7c07 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:03.689990 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0c65a1ae-fb1f-4495-83e6-83b2b14d7c07 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:03.690440 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0c65a1ae-fb1f-4495-83e6-83b2b14d7c07 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:03.822096 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-0c65a1ae-fb1f-4495-83e6-83b2b14d7c07 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:03.829661 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-0c65a1ae-fb1f-4495-83e6-83b2b14d7c07 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.153832 Aug 04 21:42:03.830256 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 156/310] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:03 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:04.695730 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-fccd4a5a-cedf-4294-b109-ade7487a3e91 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:04.696329 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-fccd4a5a-cedf-4294-b109-ade7487a3e91 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:04.703371 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fccd4a5a-cedf-4294-b109-ade7487a3e91 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:04.703843 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fccd4a5a-cedf-4294-b109-ade7487a3e91 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:04.704265 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fccd4a5a-cedf-4294-b109-ade7487a3e91 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:04.704936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fccd4a5a-cedf-4294-b109-ade7487a3e91 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:04.705376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fccd4a5a-cedf-4294-b109-ade7487a3e91 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:04.705787 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fccd4a5a-cedf-4294-b109-ade7487a3e91 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:04.836809 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-fccd4a5a-cedf-4294-b109-ade7487a3e91 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:04.845139 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-fccd4a5a-cedf-4294-b109-ade7487a3e91 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.153213 Aug 04 21:42:04.846000 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 155/311] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:04 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:04.850548 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a93e6553-8408-4ba3-acee-dd881e89fe8b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:04.851153 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a93e6553-8408-4ba3-acee-dd881e89fe8b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:04.857577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a93e6553-8408-4ba3-acee-dd881e89fe8b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:04.858067 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a93e6553-8408-4ba3-acee-dd881e89fe8b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:04.858493 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a93e6553-8408-4ba3-acee-dd881e89fe8b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:04.859169 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a93e6553-8408-4ba3-acee-dd881e89fe8b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:04.859608 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a93e6553-8408-4ba3-acee-dd881e89fe8b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:04.860022 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a93e6553-8408-4ba3-acee-dd881e89fe8b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:04.986627 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a93e6553-8408-4ba3-acee-dd881e89fe8b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:04.994140 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a93e6553-8408-4ba3-acee-dd881e89fe8b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.147403 Aug 04 21:42:04.994705 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 157/312] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:04 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:05.866030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-57fcc8e6-7b53-4850-a87d-ba823b7f5d0a tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:05.866649 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-57fcc8e6-7b53-4850-a87d-ba823b7f5d0a tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:05.872760 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57fcc8e6-7b53-4850-a87d-ba823b7f5d0a tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:05.873241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57fcc8e6-7b53-4850-a87d-ba823b7f5d0a tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:05.873667 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57fcc8e6-7b53-4850-a87d-ba823b7f5d0a tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:05.874367 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57fcc8e6-7b53-4850-a87d-ba823b7f5d0a tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:05.874806 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57fcc8e6-7b53-4850-a87d-ba823b7f5d0a tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:05.875231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57fcc8e6-7b53-4850-a87d-ba823b7f5d0a tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:06.004298 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-57fcc8e6-7b53-4850-a87d-ba823b7f5d0a tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:06.011625 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-57fcc8e6-7b53-4850-a87d-ba823b7f5d0a tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.149594 Aug 04 21:42:06.012182 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 156/313] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:05 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:06.014324 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-63fb44b5-dca6-4b4e-889c-f2a3b1aa7187 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:06.014928 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-63fb44b5-dca6-4b4e-889c-f2a3b1aa7187 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:06.021192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-63fb44b5-dca6-4b4e-889c-f2a3b1aa7187 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:06.021667 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-63fb44b5-dca6-4b4e-889c-f2a3b1aa7187 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:06.022206 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-63fb44b5-dca6-4b4e-889c-f2a3b1aa7187 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:06.022897 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-63fb44b5-dca6-4b4e-889c-f2a3b1aa7187 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:06.023339 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-63fb44b5-dca6-4b4e-889c-f2a3b1aa7187 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:06.023941 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-63fb44b5-dca6-4b4e-889c-f2a3b1aa7187 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:06.155670 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-63fb44b5-dca6-4b4e-889c-f2a3b1aa7187 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:06.159317 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:42:06.163664 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-63fb44b5-dca6-4b4e-889c-f2a3b1aa7187 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.153512 Aug 04 21:42:06.164222 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 158/314] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:06 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:07.031146 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-97446a3c-c245-4884-a672-57ea7d6870f3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:07.031752 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-97446a3c-c245-4884-a672-57ea7d6870f3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:07.037605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-97446a3c-c245-4884-a672-57ea7d6870f3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:07.038108 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-97446a3c-c245-4884-a672-57ea7d6870f3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:07.038538 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-97446a3c-c245-4884-a672-57ea7d6870f3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:07.039217 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-97446a3c-c245-4884-a672-57ea7d6870f3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:07.039664 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-97446a3c-c245-4884-a672-57ea7d6870f3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:07.040079 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-97446a3c-c245-4884-a672-57ea7d6870f3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:07.167902 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-97446a3c-c245-4884-a672-57ea7d6870f3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:07.176254 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-97446a3c-c245-4884-a672-57ea7d6870f3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.148933 Aug 04 21:42:07.176800 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 157/315] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:07 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:07.185575 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-fd027260-8fcf-478d-8a47-f767271cb62d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:07.186214 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-fd027260-8fcf-478d-8a47-f767271cb62d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:07.192856 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fd027260-8fcf-478d-8a47-f767271cb62d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:07.193331 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fd027260-8fcf-478d-8a47-f767271cb62d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:07.193759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fd027260-8fcf-478d-8a47-f767271cb62d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:07.194474 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fd027260-8fcf-478d-8a47-f767271cb62d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:07.194917 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fd027260-8fcf-478d-8a47-f767271cb62d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:07.195332 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fd027260-8fcf-478d-8a47-f767271cb62d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:07.336418 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-fd027260-8fcf-478d-8a47-f767271cb62d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:07.344575 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-fd027260-8fcf-478d-8a47-f767271cb62d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.163919 Aug 04 21:42:07.345142 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 159/316] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:07 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:08.197293 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-eda321c7-7c81-43fc-818d-06290e23f698 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:08.197838 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-eda321c7-7c81-43fc-818d-06290e23f698 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:08.204817 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eda321c7-7c81-43fc-818d-06290e23f698 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:08.205299 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eda321c7-7c81-43fc-818d-06290e23f698 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:08.205735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eda321c7-7c81-43fc-818d-06290e23f698 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:08.206460 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eda321c7-7c81-43fc-818d-06290e23f698 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:08.206911 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eda321c7-7c81-43fc-818d-06290e23f698 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:08.207332 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eda321c7-7c81-43fc-818d-06290e23f698 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:08.338822 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-eda321c7-7c81-43fc-818d-06290e23f698 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:08.346831 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-eda321c7-7c81-43fc-818d-06290e23f698 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.153456 Aug 04 21:42:08.347392 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 158/317] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:08 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:08.365396 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e0dbbde7-6686-4944-8e6b-da05d51ca480 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:08.366024 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e0dbbde7-6686-4944-8e6b-da05d51ca480 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:08.373327 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e0dbbde7-6686-4944-8e6b-da05d51ca480 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:08.373852 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e0dbbde7-6686-4944-8e6b-da05d51ca480 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:08.374312 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e0dbbde7-6686-4944-8e6b-da05d51ca480 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:08.379194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e0dbbde7-6686-4944-8e6b-da05d51ca480 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:08.379194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e0dbbde7-6686-4944-8e6b-da05d51ca480 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:08.379194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e0dbbde7-6686-4944-8e6b-da05d51ca480 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:08.513450 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e0dbbde7-6686-4944-8e6b-da05d51ca480 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:08.526893 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e0dbbde7-6686-4944-8e6b-da05d51ca480 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.165045 Aug 04 21:42:08.530697 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 160/318] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:08 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:09.368571 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b83921ed-a2c9-4fdb-b3ed-ccb624790551 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:09.369108 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b83921ed-a2c9-4fdb-b3ed-ccb624790551 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:09.375674 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b83921ed-a2c9-4fdb-b3ed-ccb624790551 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:09.376149 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b83921ed-a2c9-4fdb-b3ed-ccb624790551 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:09.376574 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b83921ed-a2c9-4fdb-b3ed-ccb624790551 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:09.377309 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b83921ed-a2c9-4fdb-b3ed-ccb624790551 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:09.377695 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b83921ed-a2c9-4fdb-b3ed-ccb624790551 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:09.378142 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b83921ed-a2c9-4fdb-b3ed-ccb624790551 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:09.511012 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b83921ed-a2c9-4fdb-b3ed-ccb624790551 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:09.519088 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b83921ed-a2c9-4fdb-b3ed-ccb624790551 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.155009 Aug 04 21:42:09.519644 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 159/319] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:09 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:09.547821 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-fb4690d1-ca86-4ec1-ae8d-6ece9eb25870 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:09.548445 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-fb4690d1-ca86-4ec1-ae8d-6ece9eb25870 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:09.554865 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fb4690d1-ca86-4ec1-ae8d-6ece9eb25870 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:09.555387 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fb4690d1-ca86-4ec1-ae8d-6ece9eb25870 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:09.555809 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fb4690d1-ca86-4ec1-ae8d-6ece9eb25870 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:09.556482 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fb4690d1-ca86-4ec1-ae8d-6ece9eb25870 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:09.556952 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fb4690d1-ca86-4ec1-ae8d-6ece9eb25870 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:09.557343 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fb4690d1-ca86-4ec1-ae8d-6ece9eb25870 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:09.688735 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-fb4690d1-ca86-4ec1-ae8d-6ece9eb25870 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:09.696495 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-fb4690d1-ca86-4ec1-ae8d-6ece9eb25870 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.152677 Aug 04 21:42:09.697054 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 161/320] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:09 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:10.540288 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-beb9e8c7-5cfc-4a81-a5f6-ebb0642ae5a7 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:10.540902 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-beb9e8c7-5cfc-4a81-a5f6-ebb0642ae5a7 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:10.546924 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-beb9e8c7-5cfc-4a81-a5f6-ebb0642ae5a7 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:10.547399 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-beb9e8c7-5cfc-4a81-a5f6-ebb0642ae5a7 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:10.547828 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-beb9e8c7-5cfc-4a81-a5f6-ebb0642ae5a7 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:10.548508 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-beb9e8c7-5cfc-4a81-a5f6-ebb0642ae5a7 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:10.548953 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-beb9e8c7-5cfc-4a81-a5f6-ebb0642ae5a7 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:10.549369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-beb9e8c7-5cfc-4a81-a5f6-ebb0642ae5a7 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:10.689453 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-beb9e8c7-5cfc-4a81-a5f6-ebb0642ae5a7 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:10.697232 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-beb9e8c7-5cfc-4a81-a5f6-ebb0642ae5a7 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.160764 Aug 04 21:42:10.697733 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 160/321] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:10 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:10.718191 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-8ca8e8c3-7736-454d-b60f-e0a7fea288a4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:10.722000 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-8ca8e8c3-7736-454d-b60f-e0a7fea288a4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:10.725001 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8ca8e8c3-7736-454d-b60f-e0a7fea288a4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:10.725499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8ca8e8c3-7736-454d-b60f-e0a7fea288a4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:10.725935 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8ca8e8c3-7736-454d-b60f-e0a7fea288a4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:10.726651 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8ca8e8c3-7736-454d-b60f-e0a7fea288a4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:10.727106 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8ca8e8c3-7736-454d-b60f-e0a7fea288a4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:10.727530 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8ca8e8c3-7736-454d-b60f-e0a7fea288a4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:10.862554 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8ca8e8c3-7736-454d-b60f-e0a7fea288a4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:10.870384 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-8ca8e8c3-7736-454d-b60f-e0a7fea288a4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.156300 Aug 04 21:42:10.870942 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 162/322] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:10 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:11.717508 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b149d369-a80c-428b-97b7-57c597737d47 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:11.718180 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b149d369-a80c-428b-97b7-57c597737d47 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:11.724226 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b149d369-a80c-428b-97b7-57c597737d47 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:11.724882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b149d369-a80c-428b-97b7-57c597737d47 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:11.725324 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b149d369-a80c-428b-97b7-57c597737d47 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:11.726047 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b149d369-a80c-428b-97b7-57c597737d47 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:11.726481 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b149d369-a80c-428b-97b7-57c597737d47 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:11.727062 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b149d369-a80c-428b-97b7-57c597737d47 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:11.875133 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b149d369-a80c-428b-97b7-57c597737d47 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:11.882502 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b149d369-a80c-428b-97b7-57c597737d47 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.169693 Aug 04 21:42:11.883055 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 161/323] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:11 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:11.892000 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-7976d733-9c70-4a80-bc1e-3e8c0b89b9ad tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:11.892607 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-7976d733-9c70-4a80-bc1e-3e8c0b89b9ad tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:11.899061 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7976d733-9c70-4a80-bc1e-3e8c0b89b9ad tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:11.899601 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7976d733-9c70-4a80-bc1e-3e8c0b89b9ad tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:11.900037 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7976d733-9c70-4a80-bc1e-3e8c0b89b9ad tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:11.901009 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7976d733-9c70-4a80-bc1e-3e8c0b89b9ad tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:11.901212 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7976d733-9c70-4a80-bc1e-3e8c0b89b9ad tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:11.901623 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7976d733-9c70-4a80-bc1e-3e8c0b89b9ad tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:12.032377 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-7976d733-9c70-4a80-bc1e-3e8c0b89b9ad tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:12.039764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-7976d733-9c70-4a80-bc1e-3e8c0b89b9ad tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.152338 Aug 04 21:42:12.040325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 163/324] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:11 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:12.904199 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-73d622c4-ff19-4017-96e9-24f1aa7f488b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:12.904794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-73d622c4-ff19-4017-96e9-24f1aa7f488b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:12.910796 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-73d622c4-ff19-4017-96e9-24f1aa7f488b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:12.911276 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-73d622c4-ff19-4017-96e9-24f1aa7f488b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:12.911700 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-73d622c4-ff19-4017-96e9-24f1aa7f488b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:12.912381 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-73d622c4-ff19-4017-96e9-24f1aa7f488b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:12.912825 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-73d622c4-ff19-4017-96e9-24f1aa7f488b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:12.913241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-73d622c4-ff19-4017-96e9-24f1aa7f488b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:13.042563 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-73d622c4-ff19-4017-96e9-24f1aa7f488b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:13.051396 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-73d622c4-ff19-4017-96e9-24f1aa7f488b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.151172 Aug 04 21:42:13.061192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f2fa2fd1-9082-4574-a42c-b9b00a4432b5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:13.061802 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-f2fa2fd1-9082-4574-a42c-b9b00a4432b5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:13.069638 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f2fa2fd1-9082-4574-a42c-b9b00a4432b5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:13.069994 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 162/325] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:12 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:13.070639 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f2fa2fd1-9082-4574-a42c-b9b00a4432b5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:13.071361 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f2fa2fd1-9082-4574-a42c-b9b00a4432b5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:13.076805 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f2fa2fd1-9082-4574-a42c-b9b00a4432b5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:13.076805 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f2fa2fd1-9082-4574-a42c-b9b00a4432b5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:13.076805 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f2fa2fd1-9082-4574-a42c-b9b00a4432b5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:13.213895 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f2fa2fd1-9082-4574-a42c-b9b00a4432b5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:13.221468 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f2fa2fd1-9082-4574-a42c-b9b00a4432b5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.164882 Aug 04 21:42:13.224012 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 164/326] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:13 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:14.055294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-afaf23ce-71c2-4910-87fc-f9ff8493fb4f req-4c350581-5040-4a87-9fe8-3b21139cfc4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a1d1620-92e5-471d-9845-d3c256391b0b", "name": "network-vif-plugged", "status": "completed", "tag": "e9fe7799-ea7c-41c5-9742-76dce429671e"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:42:14.072927 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f809d1aa-50c6-4df8-9b9a-ab53babb826f tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:14.073528 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-f809d1aa-50c6-4df8-9b9a-ab53babb826f tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:14.079662 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-afaf23ce-71c2-4910-87fc-f9ff8493fb4f req-4c350581-5040-4a87-9fe8-3b21139cfc4a service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:14.080192 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-afaf23ce-71c2-4910-87fc-f9ff8493fb4f req-4c350581-5040-4a87-9fe8-3b21139cfc4a service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:14.080772 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-afaf23ce-71c2-4910-87fc-f9ff8493fb4f req-4c350581-5040-4a87-9fe8-3b21139cfc4a service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:14.086933 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f809d1aa-50c6-4df8-9b9a-ab53babb826f tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:14.087210 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f809d1aa-50c6-4df8-9b9a-ab53babb826f tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:14.087713 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f809d1aa-50c6-4df8-9b9a-ab53babb826f tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:14.088334 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f809d1aa-50c6-4df8-9b9a-ab53babb826f tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:14.088785 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f809d1aa-50c6-4df8-9b9a-ab53babb826f tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:14.089201 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f809d1aa-50c6-4df8-9b9a-ab53babb826f tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:14.098539 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-afaf23ce-71c2-4910-87fc-f9ff8493fb4f req-4c350581-5040-4a87-9fe8-3b21139cfc4a service nova] Creating event network-vif-plugged:e9fe7799-ea7c-41c5-9742-76dce429671e for instance 8a1d1620-92e5-471d-9845-d3c256391b0b on hv-cinder-85220 Aug 04 21:42:14.103812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-afaf23ce-71c2-4910-87fc-f9ff8493fb4f req-4c350581-5040-4a87-9fe8-3b21139cfc4a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059994 Aug 04 21:42:14.105375 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 163/327] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:42:14.243726 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8d739c26-a080-4222-91e1-eac53521fe49 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:14.244442 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8d739c26-a080-4222-91e1-eac53521fe49 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:14.250870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f809d1aa-50c6-4df8-9b9a-ab53babb826f tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:14.252217 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8d739c26-a080-4222-91e1-eac53521fe49 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:14.252701 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8d739c26-a080-4222-91e1-eac53521fe49 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:14.253126 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8d739c26-a080-4222-91e1-eac53521fe49 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:14.254036 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8d739c26-a080-4222-91e1-eac53521fe49 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:14.254647 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8d739c26-a080-4222-91e1-eac53521fe49 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:14.255062 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8d739c26-a080-4222-91e1-eac53521fe49 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:14.258968 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f809d1aa-50c6-4df8-9b9a-ab53babb826f tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.190147 Aug 04 21:42:14.272476 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 165/328] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:14 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:14.447680 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8d739c26-a080-4222-91e1-eac53521fe49 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:14.455196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8d739c26-a080-4222-91e1-eac53521fe49 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.215971 Aug 04 21:42:14.455777 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 164/329] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:14 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:15.280829 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-986b05be-247f-4c15-b90b-c0def06dacef tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:15.283903 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-986b05be-247f-4c15-b90b-c0def06dacef tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:15.287879 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-986b05be-247f-4c15-b90b-c0def06dacef tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:15.288359 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-986b05be-247f-4c15-b90b-c0def06dacef tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:15.288792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-986b05be-247f-4c15-b90b-c0def06dacef tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:15.289479 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-986b05be-247f-4c15-b90b-c0def06dacef tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:15.289933 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-986b05be-247f-4c15-b90b-c0def06dacef tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:15.290383 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-986b05be-247f-4c15-b90b-c0def06dacef tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:15.427841 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-986b05be-247f-4c15-b90b-c0def06dacef tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:15.436844 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-986b05be-247f-4c15-b90b-c0def06dacef tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.160534 Aug 04 21:42:15.441734 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 166/330] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:15 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:15.476171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4aea1d80-8c99-4efe-be0c-8b7d73425a82 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:15.476850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4aea1d80-8c99-4efe-be0c-8b7d73425a82 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:15.482904 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4aea1d80-8c99-4efe-be0c-8b7d73425a82 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:15.483384 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4aea1d80-8c99-4efe-be0c-8b7d73425a82 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:15.483813 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4aea1d80-8c99-4efe-be0c-8b7d73425a82 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:15.484500 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4aea1d80-8c99-4efe-be0c-8b7d73425a82 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:15.484972 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4aea1d80-8c99-4efe-be0c-8b7d73425a82 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:15.485388 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4aea1d80-8c99-4efe-be0c-8b7d73425a82 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:15.503850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=100 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:42:15.629737 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4aea1d80-8c99-4efe-be0c-8b7d73425a82 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:15.637119 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4aea1d80-8c99-4efe-be0c-8b7d73425a82 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.164997 Aug 04 21:42:15.637669 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 165/331] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:15 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:16.456657 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-23ce7afa-2d37-4c58-afaa-9e83601d5a17 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:16.457200 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-23ce7afa-2d37-4c58-afaa-9e83601d5a17 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:16.459483 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=60 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:42:16.464077 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-23ce7afa-2d37-4c58-afaa-9e83601d5a17 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:16.464554 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-23ce7afa-2d37-4c58-afaa-9e83601d5a17 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:16.464979 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-23ce7afa-2d37-4c58-afaa-9e83601d5a17 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:16.465653 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-23ce7afa-2d37-4c58-afaa-9e83601d5a17 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:16.466124 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-23ce7afa-2d37-4c58-afaa-9e83601d5a17 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:16.467406 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-23ce7afa-2d37-4c58-afaa-9e83601d5a17 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:16.597761 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-23ce7afa-2d37-4c58-afaa-9e83601d5a17 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:16.606940 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-23ce7afa-2d37-4c58-afaa-9e83601d5a17 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.154065 Aug 04 21:42:16.608469 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 167/332] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:16 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:16.658987 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-96b30502-363d-495b-a53b-2a2ef1144080 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:16.659614 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-96b30502-363d-495b-a53b-2a2ef1144080 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:16.665981 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-96b30502-363d-495b-a53b-2a2ef1144080 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:16.666488 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-96b30502-363d-495b-a53b-2a2ef1144080 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:16.666915 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-96b30502-363d-495b-a53b-2a2ef1144080 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:16.667601 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-96b30502-363d-495b-a53b-2a2ef1144080 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:16.668042 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-96b30502-363d-495b-a53b-2a2ef1144080 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:16.668457 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-96b30502-363d-495b-a53b-2a2ef1144080 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:16.800531 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-96b30502-363d-495b-a53b-2a2ef1144080 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:16.808179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-96b30502-363d-495b-a53b-2a2ef1144080 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.153718 Aug 04 21:42:16.808741 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 166/333] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:16 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:17.630095 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-74094b4a-e7e5-49e3-94b5-76a4e56ab65b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:17.630633 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-74094b4a-e7e5-49e3-94b5-76a4e56ab65b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:17.636941 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-74094b4a-e7e5-49e3-94b5-76a4e56ab65b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:17.637455 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-74094b4a-e7e5-49e3-94b5-76a4e56ab65b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:17.637883 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-74094b4a-e7e5-49e3-94b5-76a4e56ab65b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:17.638661 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-74094b4a-e7e5-49e3-94b5-76a4e56ab65b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:17.639111 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-74094b4a-e7e5-49e3-94b5-76a4e56ab65b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:17.639524 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-74094b4a-e7e5-49e3-94b5-76a4e56ab65b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:17.770432 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-74094b4a-e7e5-49e3-94b5-76a4e56ab65b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:17.777987 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-74094b4a-e7e5-49e3-94b5-76a4e56ab65b tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.152200 Aug 04 21:42:17.778580 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 168/334] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:17 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:17.828928 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f793c4c4-c455-4c02-8ae4-963d5c81d167 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:17.829589 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-f793c4c4-c455-4c02-8ae4-963d5c81d167 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:17.835566 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f793c4c4-c455-4c02-8ae4-963d5c81d167 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:17.836045 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f793c4c4-c455-4c02-8ae4-963d5c81d167 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:17.836474 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f793c4c4-c455-4c02-8ae4-963d5c81d167 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:17.837157 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f793c4c4-c455-4c02-8ae4-963d5c81d167 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:17.837603 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f793c4c4-c455-4c02-8ae4-963d5c81d167 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:17.838046 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f793c4c4-c455-4c02-8ae4-963d5c81d167 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:17.969972 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-f793c4c4-c455-4c02-8ae4-963d5c81d167 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:17.977378 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-f793c4c4-c455-4c02-8ae4-963d5c81d167 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.152670 Aug 04 21:42:17.977965 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 167/335] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:17 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:18.798963 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-9b0b6223-6c7c-44a3-9474-7fc463859333 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:18.799491 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-9b0b6223-6c7c-44a3-9474-7fc463859333 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:18.805758 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9b0b6223-6c7c-44a3-9474-7fc463859333 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:18.806265 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9b0b6223-6c7c-44a3-9474-7fc463859333 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:18.806692 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9b0b6223-6c7c-44a3-9474-7fc463859333 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:18.807398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9b0b6223-6c7c-44a3-9474-7fc463859333 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:18.807840 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9b0b6223-6c7c-44a3-9474-7fc463859333 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:18.808257 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9b0b6223-6c7c-44a3-9474-7fc463859333 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:18.937942 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-9b0b6223-6c7c-44a3-9474-7fc463859333 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:18.945499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-9b0b6223-6c7c-44a3-9474-7fc463859333 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.151110 Aug 04 21:42:18.946088 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 169/336] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:18 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:18.998220 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-026f8de4-a723-4bb8-9a32-65e0dcd8ccef tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:18.998817 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-026f8de4-a723-4bb8-9a32-65e0dcd8ccef tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:19.005050 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-026f8de4-a723-4bb8-9a32-65e0dcd8ccef tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:19.005528 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-026f8de4-a723-4bb8-9a32-65e0dcd8ccef tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:19.005958 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-026f8de4-a723-4bb8-9a32-65e0dcd8ccef tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:19.006830 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-026f8de4-a723-4bb8-9a32-65e0dcd8ccef tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:19.007277 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-026f8de4-a723-4bb8-9a32-65e0dcd8ccef tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:19.007691 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-026f8de4-a723-4bb8-9a32-65e0dcd8ccef tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:19.138623 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-026f8de4-a723-4bb8-9a32-65e0dcd8ccef tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:19.146845 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-026f8de4-a723-4bb8-9a32-65e0dcd8ccef tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.152455 Aug 04 21:42:19.147407 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 168/337] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:18 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:19.966615 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-15f4d764-0134-498f-97c8-c862d88d9bf2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:19.967224 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-15f4d764-0134-498f-97c8-c862d88d9bf2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:19.974449 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-15f4d764-0134-498f-97c8-c862d88d9bf2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:19.974938 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-15f4d764-0134-498f-97c8-c862d88d9bf2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:19.975429 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-15f4d764-0134-498f-97c8-c862d88d9bf2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:19.976045 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-15f4d764-0134-498f-97c8-c862d88d9bf2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:19.976493 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-15f4d764-0134-498f-97c8-c862d88d9bf2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:19.976911 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-15f4d764-0134-498f-97c8-c862d88d9bf2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:20.114336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-15f4d764-0134-498f-97c8-c862d88d9bf2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:20.122279 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-15f4d764-0134-498f-97c8-c862d88d9bf2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.159373 Aug 04 21:42:20.122840 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 170/338] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:19 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:20.167795 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-915dfbec-a702-46c9-be24-423488973812 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:20.168417 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-915dfbec-a702-46c9-be24-423488973812 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:20.176468 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-915dfbec-a702-46c9-be24-423488973812 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:20.176948 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-915dfbec-a702-46c9-be24-423488973812 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:20.177577 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-915dfbec-a702-46c9-be24-423488973812 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:20.178284 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-915dfbec-a702-46c9-be24-423488973812 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:20.178734 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-915dfbec-a702-46c9-be24-423488973812 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:20.179150 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-915dfbec-a702-46c9-be24-423488973812 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:20.307276 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-915dfbec-a702-46c9-be24-423488973812 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:20.315434 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-915dfbec-a702-46c9-be24-423488973812 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.151525 Aug 04 21:42:20.316000 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 169/339] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:20 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:21.144495 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b94b2548-cfc6-494e-8077-57af7eecf567 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:21.145104 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b94b2548-cfc6-494e-8077-57af7eecf567 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:21.151271 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b94b2548-cfc6-494e-8077-57af7eecf567 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:21.151758 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b94b2548-cfc6-494e-8077-57af7eecf567 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:21.152187 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b94b2548-cfc6-494e-8077-57af7eecf567 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:21.152876 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b94b2548-cfc6-494e-8077-57af7eecf567 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:21.153324 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b94b2548-cfc6-494e-8077-57af7eecf567 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:21.153757 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b94b2548-cfc6-494e-8077-57af7eecf567 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:21.288532 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b94b2548-cfc6-494e-8077-57af7eecf567 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:21.296070 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b94b2548-cfc6-494e-8077-57af7eecf567 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.156017 Aug 04 21:42:21.297256 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 171/340] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:21 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:21.336750 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e6d0f3a0-18f4-4a8c-9d5b-26351648278b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:21.337272 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e6d0f3a0-18f4-4a8c-9d5b-26351648278b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:21.343411 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e6d0f3a0-18f4-4a8c-9d5b-26351648278b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:21.343890 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e6d0f3a0-18f4-4a8c-9d5b-26351648278b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:21.344350 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e6d0f3a0-18f4-4a8c-9d5b-26351648278b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:21.345032 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e6d0f3a0-18f4-4a8c-9d5b-26351648278b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:21.345473 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e6d0f3a0-18f4-4a8c-9d5b-26351648278b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:21.345887 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e6d0f3a0-18f4-4a8c-9d5b-26351648278b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:21.482247 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e6d0f3a0-18f4-4a8c-9d5b-26351648278b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:21.489458 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e6d0f3a0-18f4-4a8c-9d5b-26351648278b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.156680 Aug 04 21:42:21.490031 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 170/341] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:21 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:22.317545 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-6e633932-54d5-4355-8d41-9d6f243dd9ee tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:22.318187 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-6e633932-54d5-4355-8d41-9d6f243dd9ee tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:22.324596 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e633932-54d5-4355-8d41-9d6f243dd9ee tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:22.325100 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e633932-54d5-4355-8d41-9d6f243dd9ee tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:22.325547 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e633932-54d5-4355-8d41-9d6f243dd9ee tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:22.326270 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e633932-54d5-4355-8d41-9d6f243dd9ee tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:22.326722 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e633932-54d5-4355-8d41-9d6f243dd9ee tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:22.327164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e633932-54d5-4355-8d41-9d6f243dd9ee tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:22.474565 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6e633932-54d5-4355-8d41-9d6f243dd9ee tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:22.482075 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-6e633932-54d5-4355-8d41-9d6f243dd9ee tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.168481 Aug 04 21:42:22.482857 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 172/342] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:22 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:22.510237 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-740cd127-35c9-439e-b4cc-8c8cb7dd931d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:22.511094 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-740cd127-35c9-439e-b4cc-8c8cb7dd931d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:22.513069 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:42:22.518078 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-740cd127-35c9-439e-b4cc-8c8cb7dd931d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:22.518636 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-740cd127-35c9-439e-b4cc-8c8cb7dd931d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:22.519079 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-740cd127-35c9-439e-b4cc-8c8cb7dd931d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:22.519779 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-740cd127-35c9-439e-b4cc-8c8cb7dd931d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:22.520237 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-740cd127-35c9-439e-b4cc-8c8cb7dd931d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:22.521999 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-740cd127-35c9-439e-b4cc-8c8cb7dd931d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:22.657395 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-740cd127-35c9-439e-b4cc-8c8cb7dd931d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:22.665586 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-740cd127-35c9-439e-b4cc-8c8cb7dd931d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.159185 Aug 04 21:42:22.666073 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 171/343] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:22 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:23.503178 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-180823d7-3eee-4903-9094-5df358f08df2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:23.503818 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-180823d7-3eee-4903-9094-5df358f08df2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:23.510505 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-180823d7-3eee-4903-9094-5df358f08df2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:23.510989 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-180823d7-3eee-4903-9094-5df358f08df2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:23.511419 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-180823d7-3eee-4903-9094-5df358f08df2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:23.512103 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-180823d7-3eee-4903-9094-5df358f08df2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:23.512553 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-180823d7-3eee-4903-9094-5df358f08df2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:23.512973 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-180823d7-3eee-4903-9094-5df358f08df2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:23.645957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-180823d7-3eee-4903-9094-5df358f08df2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:23.653519 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-180823d7-3eee-4903-9094-5df358f08df2 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.154232 Aug 04 21:42:23.654105 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 173/344] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:23 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:23.687464 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8f332ae6-99b9-4009-8a35-754a90ea5057 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:23.688844 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8f332ae6-99b9-4009-8a35-754a90ea5057 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:23.694723 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8f332ae6-99b9-4009-8a35-754a90ea5057 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:23.695648 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8f332ae6-99b9-4009-8a35-754a90ea5057 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:23.696077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8f332ae6-99b9-4009-8a35-754a90ea5057 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:23.696765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8f332ae6-99b9-4009-8a35-754a90ea5057 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:23.697208 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8f332ae6-99b9-4009-8a35-754a90ea5057 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:23.697686 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8f332ae6-99b9-4009-8a35-754a90ea5057 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:23.832296 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8f332ae6-99b9-4009-8a35-754a90ea5057 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:23.839804 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8f332ae6-99b9-4009-8a35-754a90ea5057 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.156315 Aug 04 21:42:23.840363 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 172/345] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:23 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:24.676114 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a7db0c5c-443a-4ef7-acd4-9cb7ecaad285 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:24.676729 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a7db0c5c-443a-4ef7-acd4-9cb7ecaad285 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:24.682719 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a7db0c5c-443a-4ef7-acd4-9cb7ecaad285 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:24.683300 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a7db0c5c-443a-4ef7-acd4-9cb7ecaad285 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:24.683627 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a7db0c5c-443a-4ef7-acd4-9cb7ecaad285 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:24.684322 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a7db0c5c-443a-4ef7-acd4-9cb7ecaad285 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:24.684773 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a7db0c5c-443a-4ef7-acd4-9cb7ecaad285 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:24.685197 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a7db0c5c-443a-4ef7-acd4-9cb7ecaad285 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:24.820767 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a7db0c5c-443a-4ef7-acd4-9cb7ecaad285 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:24.829410 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a7db0c5c-443a-4ef7-acd4-9cb7ecaad285 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.158114 Aug 04 21:42:24.829969 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 174/346] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:24 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:24.860850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-534f7b64-0ca5-4017-aeaa-cbec445c5378 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:24.861458 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-534f7b64-0ca5-4017-aeaa-cbec445c5378 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:24.867480 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-534f7b64-0ca5-4017-aeaa-cbec445c5378 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:24.867962 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-534f7b64-0ca5-4017-aeaa-cbec445c5378 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:24.868646 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-534f7b64-0ca5-4017-aeaa-cbec445c5378 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:24.869324 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-534f7b64-0ca5-4017-aeaa-cbec445c5378 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:24.869769 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-534f7b64-0ca5-4017-aeaa-cbec445c5378 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:24.870218 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-534f7b64-0ca5-4017-aeaa-cbec445c5378 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:25.004840 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-534f7b64-0ca5-4017-aeaa-cbec445c5378 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:25.012348 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-534f7b64-0ca5-4017-aeaa-cbec445c5378 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.155271 Aug 04 21:42:25.012913 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 173/347] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:24 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:25.849757 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-3ef8aaf5-8c36-4c6f-a140-aacaf3ce8d40 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:25.850443 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-3ef8aaf5-8c36-4c6f-a140-aacaf3ce8d40 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:25.856766 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3ef8aaf5-8c36-4c6f-a140-aacaf3ce8d40 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:25.857237 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3ef8aaf5-8c36-4c6f-a140-aacaf3ce8d40 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:25.860750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3ef8aaf5-8c36-4c6f-a140-aacaf3ce8d40 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:25.860750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3ef8aaf5-8c36-4c6f-a140-aacaf3ce8d40 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:25.860750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3ef8aaf5-8c36-4c6f-a140-aacaf3ce8d40 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:25.860750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3ef8aaf5-8c36-4c6f-a140-aacaf3ce8d40 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:25.878373 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=100 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:42:25.992998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-3ef8aaf5-8c36-4c6f-a140-aacaf3ce8d40 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:26.001221 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-3ef8aaf5-8c36-4c6f-a140-aacaf3ce8d40 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.155334 Aug 04 21:42:26.001936 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 175/348] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:25 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:26.035293 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-402c7f59-ffab-4d21-a912-e5f2b0155fbb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:26.035293 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-402c7f59-ffab-4d21-a912-e5f2b0155fbb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:26.040722 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-402c7f59-ffab-4d21-a912-e5f2b0155fbb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:26.041266 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-402c7f59-ffab-4d21-a912-e5f2b0155fbb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:26.041615 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-402c7f59-ffab-4d21-a912-e5f2b0155fbb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:26.042340 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-402c7f59-ffab-4d21-a912-e5f2b0155fbb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:26.046186 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-402c7f59-ffab-4d21-a912-e5f2b0155fbb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:26.046186 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-402c7f59-ffab-4d21-a912-e5f2b0155fbb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:26.180961 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-402c7f59-ffab-4d21-a912-e5f2b0155fbb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:26.188609 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-402c7f59-ffab-4d21-a912-e5f2b0155fbb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.159048 Aug 04 21:42:26.189177 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 174/349] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:26 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:27.022911 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-09c396e2-3f3f-47e6-a269-566fa031fa34 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:27.023509 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-09c396e2-3f3f-47e6-a269-566fa031fa34 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:27.030052 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-09c396e2-3f3f-47e6-a269-566fa031fa34 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:27.030548 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-09c396e2-3f3f-47e6-a269-566fa031fa34 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:27.030959 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-09c396e2-3f3f-47e6-a269-566fa031fa34 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:27.032129 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-09c396e2-3f3f-47e6-a269-566fa031fa34 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:27.032576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-09c396e2-3f3f-47e6-a269-566fa031fa34 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:27.032983 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-09c396e2-3f3f-47e6-a269-566fa031fa34 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:27.188554 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-09c396e2-3f3f-47e6-a269-566fa031fa34 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:27.196013 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-09c396e2-3f3f-47e6-a269-566fa031fa34 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.176945 Aug 04 21:42:27.196572 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 176/350] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:27 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:27.210210 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-41964502-8cd9-48ba-b2bc-fb19ecfa7861 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:27.210912 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-41964502-8cd9-48ba-b2bc-fb19ecfa7861 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:27.216982 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-41964502-8cd9-48ba-b2bc-fb19ecfa7861 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:27.217544 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-41964502-8cd9-48ba-b2bc-fb19ecfa7861 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:27.217973 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-41964502-8cd9-48ba-b2bc-fb19ecfa7861 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:27.218677 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-41964502-8cd9-48ba-b2bc-fb19ecfa7861 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:27.219754 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-41964502-8cd9-48ba-b2bc-fb19ecfa7861 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:27.220137 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-41964502-8cd9-48ba-b2bc-fb19ecfa7861 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:27.355885 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-41964502-8cd9-48ba-b2bc-fb19ecfa7861 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:27.363766 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-41964502-8cd9-48ba-b2bc-fb19ecfa7861 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.157103 Aug 04 21:42:27.365351 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 175/351] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:27 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:28.219247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-303622fa-4ef0-42ff-894f-0203de7572e9 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:28.219855 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-303622fa-4ef0-42ff-894f-0203de7572e9 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:28.226411 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-303622fa-4ef0-42ff-894f-0203de7572e9 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:28.226910 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-303622fa-4ef0-42ff-894f-0203de7572e9 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:28.227321 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-303622fa-4ef0-42ff-894f-0203de7572e9 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:28.228015 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-303622fa-4ef0-42ff-894f-0203de7572e9 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:28.228456 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-303622fa-4ef0-42ff-894f-0203de7572e9 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:28.228868 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-303622fa-4ef0-42ff-894f-0203de7572e9 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:28.365088 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-303622fa-4ef0-42ff-894f-0203de7572e9 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:28.374605 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-303622fa-4ef0-42ff-894f-0203de7572e9 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.159743 Aug 04 21:42:28.375334 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 177/352] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:28 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:28.386251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e27b2ce3-283c-4988-836c-a39225f283b7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:28.387113 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e27b2ce3-283c-4988-836c-a39225f283b7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:28.394274 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e27b2ce3-283c-4988-836c-a39225f283b7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:28.395131 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e27b2ce3-283c-4988-836c-a39225f283b7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:28.395585 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e27b2ce3-283c-4988-836c-a39225f283b7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:28.396278 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e27b2ce3-283c-4988-836c-a39225f283b7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:28.396721 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e27b2ce3-283c-4988-836c-a39225f283b7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:28.397361 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e27b2ce3-283c-4988-836c-a39225f283b7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:28.542485 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e27b2ce3-283c-4988-836c-a39225f283b7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:28.550763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e27b2ce3-283c-4988-836c-a39225f283b7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.169903 Aug 04 21:42:28.551317 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 176/353] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:28 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:29.397175 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-faccc574-27f5-4e02-b4bf-d4cab303ad78 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:29.398281 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-faccc574-27f5-4e02-b4bf-d4cab303ad78 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:29.405003 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-faccc574-27f5-4e02-b4bf-d4cab303ad78 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:29.405477 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-faccc574-27f5-4e02-b4bf-d4cab303ad78 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:29.405907 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-faccc574-27f5-4e02-b4bf-d4cab303ad78 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:29.406736 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-faccc574-27f5-4e02-b4bf-d4cab303ad78 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:29.407175 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-faccc574-27f5-4e02-b4bf-d4cab303ad78 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:29.407591 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-faccc574-27f5-4e02-b4bf-d4cab303ad78 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:29.545643 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-faccc574-27f5-4e02-b4bf-d4cab303ad78 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:29.554216 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-faccc574-27f5-4e02-b4bf-d4cab303ad78 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.162307 Aug 04 21:42:29.554778 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 178/354] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:29 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:29.571331 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-5308d1a1-9942-4b3b-8bcf-155eda27dd84 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:29.571935 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-5308d1a1-9942-4b3b-8bcf-155eda27dd84 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:29.577968 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5308d1a1-9942-4b3b-8bcf-155eda27dd84 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:29.579150 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5308d1a1-9942-4b3b-8bcf-155eda27dd84 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:29.579651 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5308d1a1-9942-4b3b-8bcf-155eda27dd84 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:29.580336 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5308d1a1-9942-4b3b-8bcf-155eda27dd84 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:29.580778 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5308d1a1-9942-4b3b-8bcf-155eda27dd84 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:29.581276 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5308d1a1-9942-4b3b-8bcf-155eda27dd84 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:29.710291 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-5308d1a1-9942-4b3b-8bcf-155eda27dd84 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:29.717819 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-5308d1a1-9942-4b3b-8bcf-155eda27dd84 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.150395 Aug 04 21:42:29.718442 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 177/355] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:29 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:30.575892 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c48194ef-801d-4e71-8ce7-beedf2f9e3f9 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:30.577182 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c48194ef-801d-4e71-8ce7-beedf2f9e3f9 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:30.585185 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c48194ef-801d-4e71-8ce7-beedf2f9e3f9 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:30.585742 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c48194ef-801d-4e71-8ce7-beedf2f9e3f9 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:30.586268 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c48194ef-801d-4e71-8ce7-beedf2f9e3f9 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:30.587096 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c48194ef-801d-4e71-8ce7-beedf2f9e3f9 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:30.587574 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c48194ef-801d-4e71-8ce7-beedf2f9e3f9 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:30.588057 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c48194ef-801d-4e71-8ce7-beedf2f9e3f9 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:30.673622 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d4a4989f-4945-44a5-9bbb-a7904323a19a tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1334903381", "imageRef": "fca0c9ba-fb0a-4f30-932f-84d5253674ad", "flavorRef": "452"}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:42:30.725552 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-c48194ef-801d-4e71-8ce7-beedf2f9e3f9 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:30.729803 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.network.neutron [None req-d4a4989f-4945-44a5-9bbb-a7904323a19a tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] validate_networks() for None {{(pid=136342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:42:30.733299 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c48194ef-801d-4e71-8ce7-beedf2f9e3f9 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.161752 Aug 04 21:42:30.735637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 179/356] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:30 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:30.752469 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2fae3e00-818b-45c6-b130-5609174fb710 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:30.753080 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-2fae3e00-818b-45c6-b130-5609174fb710 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:30.759206 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2fae3e00-818b-45c6-b130-5609174fb710 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:30.759712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2fae3e00-818b-45c6-b130-5609174fb710 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:30.760145 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2fae3e00-818b-45c6-b130-5609174fb710 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:30.760844 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2fae3e00-818b-45c6-b130-5609174fb710 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:30.761292 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2fae3e00-818b-45c6-b130-5609174fb710 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:30.761711 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2fae3e00-818b-45c6-b130-5609174fb710 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:30.905611 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2fae3e00-818b-45c6-b130-5609174fb710 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:30.914640 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2fae3e00-818b-45c6-b130-5609174fb710 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.177896 Aug 04 21:42:30.915220 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 180/357] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:30 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:31.197126 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-d4a4989f-4945-44a5-9bbb-a7904323a19a tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Flavor limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:42:31.197541 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-d4a4989f-4945-44a5-9bbb-a7904323a19a tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Image limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:42:31.198030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-d4a4989f-4945-44a5-9bbb-a7904323a19a tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Flavor pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:42:31.198434 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-d4a4989f-4945-44a5-9bbb-a7904323a19a tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Image pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:42:31.198964 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-d4a4989f-4945-44a5-9bbb-a7904323a19a tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:42:31.208177 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d4a4989f-4945-44a5-9bbb-a7904323a19a tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:31.208673 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d4a4989f-4945-44a5-9bbb-a7904323a19a tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:31.209168 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d4a4989f-4945-44a5-9bbb-a7904323a19a tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:31.210057 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d4a4989f-4945-44a5-9bbb-a7904323a19a tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:31.210507 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d4a4989f-4945-44a5-9bbb-a7904323a19a tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:31.213239 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d4a4989f-4945-44a5-9bbb-a7904323a19a tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:31.228438 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-d4a4989f-4945-44a5-9bbb-a7904323a19a tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Getting quotas for project f738ce353ad649709334f71983434d3c. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:42:31.232426 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-d4a4989f-4945-44a5-9bbb-a7904323a19a tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Getting quotas for user 7487daf672c04b1bb052a8a5e4875d61 and project f738ce353ad649709334f71983434d3c. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:42:31.244972 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d4a4989f-4945-44a5-9bbb-a7904323a19a tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Going to run 1 instances... {{(pid=136342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:42:31.247413 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d4a4989f-4945-44a5-9bbb-a7904323a19a tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca0c9ba-fb0a-4f30-932f-84d5253674ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:42:31.384580 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d4a4989f-4945-44a5-9bbb-a7904323a19a tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715026 Aug 04 21:42:31.385218 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 178/358] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 4 21:42:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 21:42:31.396258 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a83e2457-5886-4f9e-a45c-b0c37bb07de0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:31.396861 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a83e2457-5886-4f9e-a45c-b0c37bb07de0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:31.477369 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a83e2457-5886-4f9e-a45c-b0c37bb07de0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:31.487651 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a83e2457-5886-4f9e-a45c-b0c37bb07de0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1215 microversion: 2.1 time: 0.094757 Aug 04 21:42:31.488008 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 181/359] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:31 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:31.759210 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-edc13adf-d6c8-4a76-be50-376f10283268 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:31.760103 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-edc13adf-d6c8-4a76-be50-376f10283268 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:31.767336 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-edc13adf-d6c8-4a76-be50-376f10283268 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:31.768449 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-edc13adf-d6c8-4a76-be50-376f10283268 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:31.769847 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-edc13adf-d6c8-4a76-be50-376f10283268 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:31.771031 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-edc13adf-d6c8-4a76-be50-376f10283268 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:31.771715 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-edc13adf-d6c8-4a76-be50-376f10283268 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:31.772553 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-edc13adf-d6c8-4a76-be50-376f10283268 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:31.907866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-edc13adf-d6c8-4a76-be50-376f10283268 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:31.916203 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-edc13adf-d6c8-4a76-be50-376f10283268 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.162914 Aug 04 21:42:31.917266 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 179/360] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:31 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:31.940380 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e68b2364-5e27-4cab-8096-254d43bd130f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:31.940380 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e68b2364-5e27-4cab-8096-254d43bd130f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:31.949354 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e68b2364-5e27-4cab-8096-254d43bd130f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:31.950043 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e68b2364-5e27-4cab-8096-254d43bd130f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:31.950646 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e68b2364-5e27-4cab-8096-254d43bd130f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:31.951354 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e68b2364-5e27-4cab-8096-254d43bd130f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:31.951900 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e68b2364-5e27-4cab-8096-254d43bd130f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:31.952487 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e68b2364-5e27-4cab-8096-254d43bd130f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:32.139228 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e68b2364-5e27-4cab-8096-254d43bd130f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:32.150547 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e68b2364-5e27-4cab-8096-254d43bd130f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.218854 Aug 04 21:42:32.151266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 182/361] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:31 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:32.507840 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-3bf6a42a-64a2-4a9f-9e00-827c4c1c36dd tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:32.514822 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-3bf6a42a-64a2-4a9f-9e00-827c4c1c36dd tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:32.527002 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bf6a42a-64a2-4a9f-9e00-827c4c1c36dd tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:32.527484 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bf6a42a-64a2-4a9f-9e00-827c4c1c36dd tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:32.527919 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bf6a42a-64a2-4a9f-9e00-827c4c1c36dd tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:32.528694 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bf6a42a-64a2-4a9f-9e00-827c4c1c36dd tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:32.529068 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bf6a42a-64a2-4a9f-9e00-827c4c1c36dd tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:32.529563 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bf6a42a-64a2-4a9f-9e00-827c4c1c36dd tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:32.628302 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-3bf6a42a-64a2-4a9f-9e00-827c4c1c36dd tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:32.637412 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-3bf6a42a-64a2-4a9f-9e00-827c4c1c36dd tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1219 microversion: 2.1 time: 0.133339 Aug 04 21:42:32.638706 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 180/362] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:32 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1219 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:32.936838 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ce6198af-f682-4c75-be03-52d93baef282 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:32.937441 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ce6198af-f682-4c75-be03-52d93baef282 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:32.943931 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ce6198af-f682-4c75-be03-52d93baef282 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:32.944521 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ce6198af-f682-4c75-be03-52d93baef282 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:32.944855 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ce6198af-f682-4c75-be03-52d93baef282 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:32.945539 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ce6198af-f682-4c75-be03-52d93baef282 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:32.945979 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ce6198af-f682-4c75-be03-52d93baef282 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:32.946428 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ce6198af-f682-4c75-be03-52d93baef282 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:33.081425 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ce6198af-f682-4c75-be03-52d93baef282 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:33.089496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ce6198af-f682-4c75-be03-52d93baef282 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.156225 Aug 04 21:42:33.090190 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 183/363] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:32 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:33.171441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a829d0ad-47fd-4aa0-aadf-d9b09b9d70ea tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:33.172127 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-a829d0ad-47fd-4aa0-aadf-d9b09b9d70ea tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:33.178165 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a829d0ad-47fd-4aa0-aadf-d9b09b9d70ea tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:33.178736 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a829d0ad-47fd-4aa0-aadf-d9b09b9d70ea tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:33.179235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a829d0ad-47fd-4aa0-aadf-d9b09b9d70ea tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:33.179927 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a829d0ad-47fd-4aa0-aadf-d9b09b9d70ea tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:33.180383 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a829d0ad-47fd-4aa0-aadf-d9b09b9d70ea tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:33.180806 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a829d0ad-47fd-4aa0-aadf-d9b09b9d70ea tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:33.287431 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-0a8ec8a8-1f29-4ef5-918f-2631014d7024 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:33.288056 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-0a8ec8a8-1f29-4ef5-918f-2631014d7024 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:33.294950 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0a8ec8a8-1f29-4ef5-918f-2631014d7024 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:33.295429 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0a8ec8a8-1f29-4ef5-918f-2631014d7024 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:33.295888 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0a8ec8a8-1f29-4ef5-918f-2631014d7024 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:33.296742 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0a8ec8a8-1f29-4ef5-918f-2631014d7024 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:33.297193 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0a8ec8a8-1f29-4ef5-918f-2631014d7024 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:33.298586 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0a8ec8a8-1f29-4ef5-918f-2631014d7024 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:33.324441 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-0a8ec8a8-1f29-4ef5-918f-2631014d7024 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Going to try to terminate instance {{(pid=136341) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:42:33.330820 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-a829d0ad-47fd-4aa0-aadf-d9b09b9d70ea tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:33.338658 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-a829d0ad-47fd-4aa0-aadf-d9b09b9d70ea tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.171081 Aug 04 21:42:33.339459 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 181/364] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:33 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:33.658550 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d7bc98c2-8d56-4d09-a83e-591b9cf67c8b tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:33.659153 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d7bc98c2-8d56-4d09-a83e-591b9cf67c8b tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:33.665089 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d7bc98c2-8d56-4d09-a83e-591b9cf67c8b tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:33.665549 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d7bc98c2-8d56-4d09-a83e-591b9cf67c8b tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:33.665976 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d7bc98c2-8d56-4d09-a83e-591b9cf67c8b tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:33.666723 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d7bc98c2-8d56-4d09-a83e-591b9cf67c8b tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:33.667160 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d7bc98c2-8d56-4d09-a83e-591b9cf67c8b tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:33.667575 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d7bc98c2-8d56-4d09-a83e-591b9cf67c8b tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:33.729049 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d7bc98c2-8d56-4d09-a83e-591b9cf67c8b tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:33.732410 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=100 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:42:33.737773 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d7bc98c2-8d56-4d09-a83e-591b9cf67c8b tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1211 microversion: 2.1 time: 0.083178 Aug 04 21:42:33.738372 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 182/365] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:33 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:33.778510 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-0a8ec8a8-1f29-4ef5-918f-2631014d7024 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "DELETE /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 204 len: 0 microversion: 2.1 time: 0.494879 Aug 04 21:42:33.779481 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 184/366] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:42:33 2022] DELETE /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 21:42:33.788192 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-12d4e6ab-bc8c-447d-9bc9-be36f833d75b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:33.789947 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-12d4e6ab-bc8c-447d-9bc9-be36f833d75b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:33.797009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-12d4e6ab-bc8c-447d-9bc9-be36f833d75b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:33.799017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-12d4e6ab-bc8c-447d-9bc9-be36f833d75b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:33.799811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-12d4e6ab-bc8c-447d-9bc9-be36f833d75b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:33.800584 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-12d4e6ab-bc8c-447d-9bc9-be36f833d75b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:33.801730 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-12d4e6ab-bc8c-447d-9bc9-be36f833d75b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:33.802234 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-12d4e6ab-bc8c-447d-9bc9-be36f833d75b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:33.966167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-12d4e6ab-bc8c-447d-9bc9-be36f833d75b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:33.974767 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-12d4e6ab-bc8c-447d-9bc9-be36f833d75b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1555 microversion: 2.1 time: 0.190831 Aug 04 21:42:33.975329 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 183/367] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:33 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1555 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:34.110867 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b5b4cb5e-2bb7-42fa-ad63-8a18d316663d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:34.111688 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b5b4cb5e-2bb7-42fa-ad63-8a18d316663d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:34.117998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b5b4cb5e-2bb7-42fa-ad63-8a18d316663d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:34.118759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b5b4cb5e-2bb7-42fa-ad63-8a18d316663d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:34.119193 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b5b4cb5e-2bb7-42fa-ad63-8a18d316663d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:34.119884 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b5b4cb5e-2bb7-42fa-ad63-8a18d316663d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:34.120361 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b5b4cb5e-2bb7-42fa-ad63-8a18d316663d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:34.120782 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b5b4cb5e-2bb7-42fa-ad63-8a18d316663d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:34.258508 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b5b4cb5e-2bb7-42fa-ad63-8a18d316663d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:34.265820 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b5b4cb5e-2bb7-42fa-ad63-8a18d316663d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.159195 Aug 04 21:42:34.266641 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 185/368] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:34 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:34.360404 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-206358a2-081d-44ea-a2ce-84714848b4fa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:34.361110 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-206358a2-081d-44ea-a2ce-84714848b4fa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:34.367035 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-206358a2-081d-44ea-a2ce-84714848b4fa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:34.367507 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-206358a2-081d-44ea-a2ce-84714848b4fa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:34.367936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-206358a2-081d-44ea-a2ce-84714848b4fa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:34.368866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-206358a2-081d-44ea-a2ce-84714848b4fa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:34.369307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-206358a2-081d-44ea-a2ce-84714848b4fa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:34.369731 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-206358a2-081d-44ea-a2ce-84714848b4fa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:34.505345 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-206358a2-081d-44ea-a2ce-84714848b4fa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:34.513010 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-206358a2-081d-44ea-a2ce-84714848b4fa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.157129 Aug 04 21:42:34.513569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 184/369] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:34 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:34.760602 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-73278b61-5598-4b56-9476-91494574efb2 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:34.761225 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-73278b61-5598-4b56-9476-91494574efb2 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:34.769709 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-73278b61-5598-4b56-9476-91494574efb2 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:34.774961 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-73278b61-5598-4b56-9476-91494574efb2 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:34.774961 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-73278b61-5598-4b56-9476-91494574efb2 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:34.774961 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-73278b61-5598-4b56-9476-91494574efb2 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:34.774961 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-73278b61-5598-4b56-9476-91494574efb2 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:34.775425 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-73278b61-5598-4b56-9476-91494574efb2 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:34.838984 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-73278b61-5598-4b56-9476-91494574efb2 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:34.846537 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-73278b61-5598-4b56-9476-91494574efb2 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1267 microversion: 2.1 time: 0.090050 Aug 04 21:42:34.847088 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 186/370] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:34 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:34.995979 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-fee1b0fd-240d-4aa9-9c58-78b3f0acdbd3 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:34.996578 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-fee1b0fd-240d-4aa9-9c58-78b3f0acdbd3 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:35.003028 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fee1b0fd-240d-4aa9-9c58-78b3f0acdbd3 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:35.007390 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fee1b0fd-240d-4aa9-9c58-78b3f0acdbd3 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:35.007390 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fee1b0fd-240d-4aa9-9c58-78b3f0acdbd3 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:35.007390 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fee1b0fd-240d-4aa9-9c58-78b3f0acdbd3 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:35.007390 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fee1b0fd-240d-4aa9-9c58-78b3f0acdbd3 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:35.007848 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fee1b0fd-240d-4aa9-9c58-78b3f0acdbd3 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:35.142257 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-fee1b0fd-240d-4aa9-9c58-78b3f0acdbd3 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:35.150958 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-fee1b0fd-240d-4aa9-9c58-78b3f0acdbd3 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1555 microversion: 2.1 time: 0.159118 Aug 04 21:42:35.151518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 185/371] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:34 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:35.286971 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-343b398d-9d32-4299-84d5-9ad7405a5cce tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:35.287491 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-343b398d-9d32-4299-84d5-9ad7405a5cce tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:35.294027 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-343b398d-9d32-4299-84d5-9ad7405a5cce tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:35.294523 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-343b398d-9d32-4299-84d5-9ad7405a5cce tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:35.294961 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-343b398d-9d32-4299-84d5-9ad7405a5cce tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:35.295645 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-343b398d-9d32-4299-84d5-9ad7405a5cce tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:35.296094 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-343b398d-9d32-4299-84d5-9ad7405a5cce tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:35.296515 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-343b398d-9d32-4299-84d5-9ad7405a5cce tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:35.436592 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-343b398d-9d32-4299-84d5-9ad7405a5cce tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:35.445866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-343b398d-9d32-4299-84d5-9ad7405a5cce tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.162770 Aug 04 21:42:35.447846 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 187/372] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:35 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:35.535720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-859372b8-d526-4446-9610-0889948cbcde tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:35.536321 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-859372b8-d526-4446-9610-0889948cbcde tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:35.542281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-859372b8-d526-4446-9610-0889948cbcde tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:35.542698 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-859372b8-d526-4446-9610-0889948cbcde tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:35.543122 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-859372b8-d526-4446-9610-0889948cbcde tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:35.543794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-859372b8-d526-4446-9610-0889948cbcde tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:35.544234 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-859372b8-d526-4446-9610-0889948cbcde tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:35.544647 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-859372b8-d526-4446-9610-0889948cbcde tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:35.716485 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-859372b8-d526-4446-9610-0889948cbcde tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:35.727590 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-859372b8-d526-4446-9610-0889948cbcde tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.196666 Aug 04 21:42:35.728174 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 186/373] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:35 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:35.866642 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-7becdfdf-7b13-4c6e-9863-6b11081ae31e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:35.867162 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-7becdfdf-7b13-4c6e-9863-6b11081ae31e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:35.873345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7becdfdf-7b13-4c6e-9863-6b11081ae31e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:35.873817 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7becdfdf-7b13-4c6e-9863-6b11081ae31e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:35.874276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7becdfdf-7b13-4c6e-9863-6b11081ae31e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:35.874947 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7becdfdf-7b13-4c6e-9863-6b11081ae31e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:35.875390 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7becdfdf-7b13-4c6e-9863-6b11081ae31e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:35.876564 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7becdfdf-7b13-4c6e-9863-6b11081ae31e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:35.942569 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-7becdfdf-7b13-4c6e-9863-6b11081ae31e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:35.950239 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-7becdfdf-7b13-4c6e-9863-6b11081ae31e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1267 microversion: 2.1 time: 0.087501 Aug 04 21:42:35.950801 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 188/374] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:35 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:36.173370 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-440fcecc-ee07-4947-897a-e67452023bac tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:36.174048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-440fcecc-ee07-4947-897a-e67452023bac tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:36.180968 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-440fcecc-ee07-4947-897a-e67452023bac tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:36.181454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-440fcecc-ee07-4947-897a-e67452023bac tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:36.181906 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-440fcecc-ee07-4947-897a-e67452023bac tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:36.182654 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-440fcecc-ee07-4947-897a-e67452023bac tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:36.183106 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-440fcecc-ee07-4947-897a-e67452023bac tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:36.183524 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-440fcecc-ee07-4947-897a-e67452023bac tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:36.318333 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-440fcecc-ee07-4947-897a-e67452023bac tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:36.326407 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-440fcecc-ee07-4947-897a-e67452023bac tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1555 microversion: 2.1 time: 0.156876 Aug 04 21:42:36.326964 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 187/375] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:36 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:36.467271 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ac879df2-f347-4f2e-8b68-71815370acab tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:36.467945 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ac879df2-f347-4f2e-8b68-71815370acab tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:36.475290 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ac879df2-f347-4f2e-8b68-71815370acab tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:36.475776 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ac879df2-f347-4f2e-8b68-71815370acab tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:36.476247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ac879df2-f347-4f2e-8b68-71815370acab tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:36.476944 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ac879df2-f347-4f2e-8b68-71815370acab tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:36.477398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ac879df2-f347-4f2e-8b68-71815370acab tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:36.477816 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ac879df2-f347-4f2e-8b68-71815370acab tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:36.613778 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ac879df2-f347-4f2e-8b68-71815370acab tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:36.621410 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ac879df2-f347-4f2e-8b68-71815370acab tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1312 microversion: 2.1 time: 0.158401 Aug 04 21:42:36.621975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 189/376] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:36 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:36.748918 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-5d91bca8-1209-43e9-8697-5a1c3c185c91 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:36.749531 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-5d91bca8-1209-43e9-8697-5a1c3c185c91 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:36.755610 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5d91bca8-1209-43e9-8697-5a1c3c185c91 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:36.756100 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5d91bca8-1209-43e9-8697-5a1c3c185c91 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:36.756530 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5d91bca8-1209-43e9-8697-5a1c3c185c91 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:36.757251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5d91bca8-1209-43e9-8697-5a1c3c185c91 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:36.757756 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5d91bca8-1209-43e9-8697-5a1c3c185c91 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:36.758213 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5d91bca8-1209-43e9-8697-5a1c3c185c91 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:36.891534 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-5d91bca8-1209-43e9-8697-5a1c3c185c91 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:36.899482 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-5d91bca8-1209-43e9-8697-5a1c3c185c91 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.154516 Aug 04 21:42:36.900036 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 188/377] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:36 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:36.971566 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-259e0cbf-0cd8-4f27-8ccb-2eab9512d623 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:36.973407 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-259e0cbf-0cd8-4f27-8ccb-2eab9512d623 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:36.979415 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-259e0cbf-0cd8-4f27-8ccb-2eab9512d623 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:36.979898 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-259e0cbf-0cd8-4f27-8ccb-2eab9512d623 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:36.980325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-259e0cbf-0cd8-4f27-8ccb-2eab9512d623 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:36.981008 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-259e0cbf-0cd8-4f27-8ccb-2eab9512d623 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:36.981452 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-259e0cbf-0cd8-4f27-8ccb-2eab9512d623 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:36.981867 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-259e0cbf-0cd8-4f27-8ccb-2eab9512d623 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:37.043029 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-259e0cbf-0cd8-4f27-8ccb-2eab9512d623 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:37.050524 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-259e0cbf-0cd8-4f27-8ccb-2eab9512d623 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1267 microversion: 2.1 time: 0.082447 Aug 04 21:42:37.051162 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 190/378] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:36 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:37.347495 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-5398863e-9327-4777-8872-98efb89c4b0e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:37.348066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-5398863e-9327-4777-8872-98efb89c4b0e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:37.353933 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5398863e-9327-4777-8872-98efb89c4b0e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:37.354447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5398863e-9327-4777-8872-98efb89c4b0e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:37.354879 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5398863e-9327-4777-8872-98efb89c4b0e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:37.355611 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5398863e-9327-4777-8872-98efb89c4b0e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:37.356034 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5398863e-9327-4777-8872-98efb89c4b0e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:37.356467 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5398863e-9327-4777-8872-98efb89c4b0e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:37.509144 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-5398863e-9327-4777-8872-98efb89c4b0e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:37.517173 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-5398863e-9327-4777-8872-98efb89c4b0e tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1555 microversion: 2.1 time: 0.174158 Aug 04 21:42:37.517728 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 189/379] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:37 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1555 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:37.641702 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2d76f781-7147-4178-b292-c50c79c8c01c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:37.642327 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-2d76f781-7147-4178-b292-c50c79c8c01c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:37.649103 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2d76f781-7147-4178-b292-c50c79c8c01c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:37.649584 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2d76f781-7147-4178-b292-c50c79c8c01c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:37.650034 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2d76f781-7147-4178-b292-c50c79c8c01c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:37.650712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2d76f781-7147-4178-b292-c50c79c8c01c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:37.651153 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2d76f781-7147-4178-b292-c50c79c8c01c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:37.651568 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2d76f781-7147-4178-b292-c50c79c8c01c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:37.669907 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:42:37.784607 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2d76f781-7147-4178-b292-c50c79c8c01c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:37.792543 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2d76f781-7147-4178-b292-c50c79c8c01c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1497 microversion: 2.1 time: 0.154674 Aug 04 21:42:37.793180 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 191/380] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:37 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:37.921865 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-107fa2fa-b8f5-426b-aa12-f78f6d361ac7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:37.926211 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-107fa2fa-b8f5-426b-aa12-f78f6d361ac7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:37.932398 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-107fa2fa-b8f5-426b-aa12-f78f6d361ac7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:37.932886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-107fa2fa-b8f5-426b-aa12-f78f6d361ac7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:37.936842 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-107fa2fa-b8f5-426b-aa12-f78f6d361ac7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:37.936842 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-107fa2fa-b8f5-426b-aa12-f78f6d361ac7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:37.936842 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-107fa2fa-b8f5-426b-aa12-f78f6d361ac7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:37.936842 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-107fa2fa-b8f5-426b-aa12-f78f6d361ac7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:38.071780 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2ea6f27c-2faf-4b95-93e2-3649cb21cb40 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:38.072567 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-2ea6f27c-2faf-4b95-93e2-3649cb21cb40 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:38.076001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-107fa2fa-b8f5-426b-aa12-f78f6d361ac7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:38.085361 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2ea6f27c-2faf-4b95-93e2-3649cb21cb40 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:38.089034 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-107fa2fa-b8f5-426b-aa12-f78f6d361ac7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.167738 Aug 04 21:42:38.089151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2ea6f27c-2faf-4b95-93e2-3649cb21cb40 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:38.089151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2ea6f27c-2faf-4b95-93e2-3649cb21cb40 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:38.089310 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 190/381] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:37 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:38.089394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2ea6f27c-2faf-4b95-93e2-3649cb21cb40 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:38.089394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2ea6f27c-2faf-4b95-93e2-3649cb21cb40 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:38.089394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2ea6f27c-2faf-4b95-93e2-3649cb21cb40 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:38.151614 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2ea6f27c-2faf-4b95-93e2-3649cb21cb40 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:38.160284 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2ea6f27c-2faf-4b95-93e2-3649cb21cb40 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1267 microversion: 2.1 time: 0.092814 Aug 04 21:42:38.160867 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 192/382] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:38 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1267 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:38.541722 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ed8c06b3-6740-48fd-9e3a-d69ef04920b4 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:38.541722 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ed8c06b3-6740-48fd-9e3a-d69ef04920b4 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:38.546163 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ed8c06b3-6740-48fd-9e3a-d69ef04920b4 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:38.546685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ed8c06b3-6740-48fd-9e3a-d69ef04920b4 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:38.547107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ed8c06b3-6740-48fd-9e3a-d69ef04920b4 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:38.547780 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ed8c06b3-6740-48fd-9e3a-d69ef04920b4 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:38.548221 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ed8c06b3-6740-48fd-9e3a-d69ef04920b4 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:38.548639 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ed8c06b3-6740-48fd-9e3a-d69ef04920b4 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:38.675908 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ed8c06b3-6740-48fd-9e3a-d69ef04920b4 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:38.684384 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ed8c06b3-6740-48fd-9e3a-d69ef04920b4 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1555 microversion: 2.1 time: 0.149057 Aug 04 21:42:38.684950 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 191/383] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:38 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:38.813449 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e0a76b31-e271-4da9-89e9-e84b3b1a5fc7 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:38.813939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e0a76b31-e271-4da9-89e9-e84b3b1a5fc7 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:38.821588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e0a76b31-e271-4da9-89e9-e84b3b1a5fc7 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:38.822107 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e0a76b31-e271-4da9-89e9-e84b3b1a5fc7 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:38.822734 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e0a76b31-e271-4da9-89e9-e84b3b1a5fc7 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:38.823435 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e0a76b31-e271-4da9-89e9-e84b3b1a5fc7 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:38.823881 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e0a76b31-e271-4da9-89e9-e84b3b1a5fc7 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:38.824300 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e0a76b31-e271-4da9-89e9-e84b3b1a5fc7 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:38.850746 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e0a76b31-e271-4da9-89e9-e84b3b1a5fc7 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Going to try to terminate instance {{(pid=136341) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:42:39.108723 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4c842908-42ad-45e8-adcf-0d7475414c21 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:39.109323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4c842908-42ad-45e8-adcf-0d7475414c21 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:39.115962 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c842908-42ad-45e8-adcf-0d7475414c21 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:39.116429 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c842908-42ad-45e8-adcf-0d7475414c21 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:39.116853 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c842908-42ad-45e8-adcf-0d7475414c21 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:39.117556 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c842908-42ad-45e8-adcf-0d7475414c21 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:39.118152 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c842908-42ad-45e8-adcf-0d7475414c21 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:39.118827 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c842908-42ad-45e8-adcf-0d7475414c21 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:39.164955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e0a76b31-e271-4da9-89e9-e84b3b1a5fc7 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 204 len: 0 microversion: 2.1 time: 0.355030 Aug 04 21:42:39.165682 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 193/384] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:42:38 2022] DELETE /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:42:39.174120 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-626a4e83-fa85-4e22-b5ec-b0e17bbf12f3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:39.174937 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-626a4e83-fa85-4e22-b5ec-b0e17bbf12f3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:39.181494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-626a4e83-fa85-4e22-b5ec-b0e17bbf12f3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:39.181975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-626a4e83-fa85-4e22-b5ec-b0e17bbf12f3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:39.182447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-626a4e83-fa85-4e22-b5ec-b0e17bbf12f3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:39.183129 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-626a4e83-fa85-4e22-b5ec-b0e17bbf12f3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:39.183572 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-626a4e83-fa85-4e22-b5ec-b0e17bbf12f3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:39.183985 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-626a4e83-fa85-4e22-b5ec-b0e17bbf12f3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:39.252538 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4c842908-42ad-45e8-adcf-0d7475414c21 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:39.261287 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4c842908-42ad-45e8-adcf-0d7475414c21 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.156423 Aug 04 21:42:39.262327 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 192/385] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:39 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:39.266846 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f1e662c4-b5ae-40bb-8dbc-2a6da88385d3 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:39.267443 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-f1e662c4-b5ae-40bb-8dbc-2a6da88385d3 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:39.274213 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f1e662c4-b5ae-40bb-8dbc-2a6da88385d3 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:39.274703 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f1e662c4-b5ae-40bb-8dbc-2a6da88385d3 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:39.275128 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f1e662c4-b5ae-40bb-8dbc-2a6da88385d3 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:39.275980 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f1e662c4-b5ae-40bb-8dbc-2a6da88385d3 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:39.276586 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f1e662c4-b5ae-40bb-8dbc-2a6da88385d3 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:39.277054 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f1e662c4-b5ae-40bb-8dbc-2a6da88385d3 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:39.315810 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-626a4e83-fa85-4e22-b5ec-b0e17bbf12f3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:39.324243 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-626a4e83-fa85-4e22-b5ec-b0e17bbf12f3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1503 microversion: 2.1 time: 0.154121 Aug 04 21:42:39.325356 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 194/386] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:39 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:39.342849 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-f1e662c4-b5ae-40bb-8dbc-2a6da88385d3 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:39.352747 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-f1e662c4-b5ae-40bb-8dbc-2a6da88385d3 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1275 microversion: 2.1 time: 0.089401 Aug 04 21:42:39.353305 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 193/387] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:39 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1275 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:39.709411 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-9d9ff797-c86b-4a6b-8c4d-16a91ab58b71 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:39.710049 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-9d9ff797-c86b-4a6b-8c4d-16a91ab58b71 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:39.715954 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9d9ff797-c86b-4a6b-8c4d-16a91ab58b71 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:39.716432 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9d9ff797-c86b-4a6b-8c4d-16a91ab58b71 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:39.716862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9d9ff797-c86b-4a6b-8c4d-16a91ab58b71 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:39.717546 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9d9ff797-c86b-4a6b-8c4d-16a91ab58b71 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:39.717996 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9d9ff797-c86b-4a6b-8c4d-16a91ab58b71 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:39.718441 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9d9ff797-c86b-4a6b-8c4d-16a91ab58b71 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:39.849550 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-9d9ff797-c86b-4a6b-8c4d-16a91ab58b71 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:39.857654 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-9d9ff797-c86b-4a6b-8c4d-16a91ab58b71 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1555 microversion: 2.1 time: 0.152730 Aug 04 21:42:39.858253 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 195/388] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:39 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:40.282470 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-cd30ce88-9e70-4662-9ff0-aafd20e48310 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:40.283069 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-cd30ce88-9e70-4662-9ff0-aafd20e48310 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:40.289731 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cd30ce88-9e70-4662-9ff0-aafd20e48310 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:40.290255 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cd30ce88-9e70-4662-9ff0-aafd20e48310 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:40.290684 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cd30ce88-9e70-4662-9ff0-aafd20e48310 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:40.291371 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cd30ce88-9e70-4662-9ff0-aafd20e48310 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:40.291815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cd30ce88-9e70-4662-9ff0-aafd20e48310 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:40.292236 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cd30ce88-9e70-4662-9ff0-aafd20e48310 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:40.345068 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-274b874a-0700-418c-9482-7e3af3d1de2d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:40.345671 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-274b874a-0700-418c-9482-7e3af3d1de2d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:40.353569 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-274b874a-0700-418c-9482-7e3af3d1de2d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:40.353998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-274b874a-0700-418c-9482-7e3af3d1de2d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:40.354468 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-274b874a-0700-418c-9482-7e3af3d1de2d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:40.355171 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-274b874a-0700-418c-9482-7e3af3d1de2d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:40.355625 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-274b874a-0700-418c-9482-7e3af3d1de2d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:40.356042 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-274b874a-0700-418c-9482-7e3af3d1de2d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:40.424543 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-cd30ce88-9e70-4662-9ff0-aafd20e48310 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:40.432513 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-cd30ce88-9e70-4662-9ff0-aafd20e48310 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.153844 Aug 04 21:42:40.433172 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 194/389] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:40 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:40.438221 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-25f7a341-9946-41bf-b40e-c74730fca0c0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:40.438809 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-25f7a341-9946-41bf-b40e-c74730fca0c0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:40.444884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-25f7a341-9946-41bf-b40e-c74730fca0c0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:40.445438 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-25f7a341-9946-41bf-b40e-c74730fca0c0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:40.446122 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-25f7a341-9946-41bf-b40e-c74730fca0c0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:40.446974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-25f7a341-9946-41bf-b40e-c74730fca0c0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:40.447431 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-25f7a341-9946-41bf-b40e-c74730fca0c0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:40.447850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-25f7a341-9946-41bf-b40e-c74730fca0c0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:40.492289 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-274b874a-0700-418c-9482-7e3af3d1de2d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:40.499975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-274b874a-0700-418c-9482-7e3af3d1de2d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1503 microversion: 2.1 time: 0.158917 Aug 04 21:42:40.500537 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 196/390] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:40 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:40.513635 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-25f7a341-9946-41bf-b40e-c74730fca0c0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:40.521782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-25f7a341-9946-41bf-b40e-c74730fca0c0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1285 microversion: 2.1 time: 0.087567 Aug 04 21:42:40.522362 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 195/391] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:40 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:40.881536 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-66beaf5d-474b-4f9f-8036-72bb8416e49a tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:40.884338 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-66beaf5d-474b-4f9f-8036-72bb8416e49a tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:40.896479 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-66beaf5d-474b-4f9f-8036-72bb8416e49a tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:40.896970 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-66beaf5d-474b-4f9f-8036-72bb8416e49a tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:40.897408 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-66beaf5d-474b-4f9f-8036-72bb8416e49a tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:40.900376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-66beaf5d-474b-4f9f-8036-72bb8416e49a tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:40.900968 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-66beaf5d-474b-4f9f-8036-72bb8416e49a tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:40.901310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-66beaf5d-474b-4f9f-8036-72bb8416e49a tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:41.158323 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-66beaf5d-474b-4f9f-8036-72bb8416e49a tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:41.172404 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-66beaf5d-474b-4f9f-8036-72bb8416e49a tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1555 microversion: 2.1 time: 0.296229 Aug 04 21:42:41.173003 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 197/392] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:40 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1555 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:41.452773 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-7d21231c-afbb-4380-b15e-58b029a617ed tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:41.453420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7d21231c-afbb-4380-b15e-58b029a617ed tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:41.455349 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=2 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:42:41.455998 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=6 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:42:41.460912 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7d21231c-afbb-4380-b15e-58b029a617ed tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:41.461395 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7d21231c-afbb-4380-b15e-58b029a617ed tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:41.461830 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7d21231c-afbb-4380-b15e-58b029a617ed tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:41.462551 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7d21231c-afbb-4380-b15e-58b029a617ed tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:41.463001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7d21231c-afbb-4380-b15e-58b029a617ed tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:41.463418 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7d21231c-afbb-4380-b15e-58b029a617ed tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:41.533560 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e7de0264-95de-4ce1-a2e7-d32d2541a2eb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:41.535369 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e7de0264-95de-4ce1-a2e7-d32d2541a2eb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:41.541179 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=2 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:42:41.549811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e7de0264-95de-4ce1-a2e7-d32d2541a2eb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:41.552039 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e7de0264-95de-4ce1-a2e7-d32d2541a2eb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:41.554914 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e7de0264-95de-4ce1-a2e7-d32d2541a2eb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:41.556268 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e7de0264-95de-4ce1-a2e7-d32d2541a2eb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:41.557448 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e7de0264-95de-4ce1-a2e7-d32d2541a2eb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:41.558554 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e7de0264-95de-4ce1-a2e7-d32d2541a2eb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:41.672153 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7d21231c-afbb-4380-b15e-58b029a617ed tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:41.680811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-7d21231c-afbb-4380-b15e-58b029a617ed tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.231856 Aug 04 21:42:41.694393 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 196/393] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:41 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:41.699399 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-fbd43f85-afe8-40f2-8e27-c7da3ef914ae tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:41.700105 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-fbd43f85-afe8-40f2-8e27-c7da3ef914ae tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:41.714623 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fbd43f85-afe8-40f2-8e27-c7da3ef914ae tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:41.715423 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fbd43f85-afe8-40f2-8e27-c7da3ef914ae tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:41.715558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fbd43f85-afe8-40f2-8e27-c7da3ef914ae tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:41.716789 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fbd43f85-afe8-40f2-8e27-c7da3ef914ae tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:41.717014 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fbd43f85-afe8-40f2-8e27-c7da3ef914ae tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:41.717443 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fbd43f85-afe8-40f2-8e27-c7da3ef914ae tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:41.732662 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e7de0264-95de-4ce1-a2e7-d32d2541a2eb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:41.741633 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e7de0264-95de-4ce1-a2e7-d32d2541a2eb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1503 microversion: 2.1 time: 0.211811 Aug 04 21:42:41.742250 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 198/394] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:41 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1503 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:41.760388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-7f997a5a-26b5-4949-8130-426807ce1593 req-9b49ea92-0724-494d-94f2-3975bf51252e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b3cb09-2341-45b6-85aa-26706dd17e65", "name": "network-vif-deleted", "tag": "d31cf969-7aa9-4aed-8a90-7b1398f0f788"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:42:41.771591 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-7f997a5a-26b5-4949-8130-426807ce1593 req-9b49ea92-0724-494d-94f2-3975bf51252e service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:41.772068 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-7f997a5a-26b5-4949-8130-426807ce1593 req-9b49ea92-0724-494d-94f2-3975bf51252e service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:41.772489 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-7f997a5a-26b5-4949-8130-426807ce1593 req-9b49ea92-0724-494d-94f2-3975bf51252e service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:41.786388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-7f997a5a-26b5-4949-8130-426807ce1593 req-9b49ea92-0724-494d-94f2-3975bf51252e service nova] Creating event network-vif-deleted:d31cf969-7aa9-4aed-8a90-7b1398f0f788 for instance 80b3cb09-2341-45b6-85aa-26706dd17e65 on hv-cinder-85220 Aug 04 21:42:41.788801 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-fbd43f85-afe8-40f2-8e27-c7da3ef914ae tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:41.793562 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-7f997a5a-26b5-4949-8130-426807ce1593 req-9b49ea92-0724-494d-94f2-3975bf51252e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048417 Aug 04 21:42:41.793880 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 199/395] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:42:41.798173 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-fbd43f85-afe8-40f2-8e27-c7da3ef914ae tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1273 microversion: 2.1 time: 0.115553 Aug 04 21:42:41.798630 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 197/396] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:41 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1273 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:42.195027 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-1b793373-56ec-4a80-b08d-b3be6274f3a0 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:42.195720 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-1b793373-56ec-4a80-b08d-b3be6274f3a0 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:42.202306 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1b793373-56ec-4a80-b08d-b3be6274f3a0 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:42.202787 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1b793373-56ec-4a80-b08d-b3be6274f3a0 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:42.203227 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1b793373-56ec-4a80-b08d-b3be6274f3a0 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:42.203908 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1b793373-56ec-4a80-b08d-b3be6274f3a0 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:42.204359 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1b793373-56ec-4a80-b08d-b3be6274f3a0 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:42.204776 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1b793373-56ec-4a80-b08d-b3be6274f3a0 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:42.273902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-1b793373-56ec-4a80-b08d-b3be6274f3a0 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:42.282036 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-1b793373-56ec-4a80-b08d-b3be6274f3a0 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1346 microversion: 2.1 time: 0.091805 Aug 04 21:42:42.282606 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 200/397] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:42 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:42.704041 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-0ff571a9-2811-4cd2-b184-3a106143b1a8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:42.704646 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-0ff571a9-2811-4cd2-b184-3a106143b1a8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:42.711378 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0ff571a9-2811-4cd2-b184-3a106143b1a8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:42.712134 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0ff571a9-2811-4cd2-b184-3a106143b1a8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:42.712267 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0ff571a9-2811-4cd2-b184-3a106143b1a8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:42.712968 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0ff571a9-2811-4cd2-b184-3a106143b1a8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:42.713413 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0ff571a9-2811-4cd2-b184-3a106143b1a8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:42.713847 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0ff571a9-2811-4cd2-b184-3a106143b1a8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:42.763758 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-230822e7-9cda-40d0-b423-79696b5bcfcf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:42.764359 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-230822e7-9cda-40d0-b423-79696b5bcfcf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:42.770806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-230822e7-9cda-40d0-b423-79696b5bcfcf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:42.771289 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-230822e7-9cda-40d0-b423-79696b5bcfcf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:42.771752 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-230822e7-9cda-40d0-b423-79696b5bcfcf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:42.772440 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-230822e7-9cda-40d0-b423-79696b5bcfcf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:42.772887 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-230822e7-9cda-40d0-b423-79696b5bcfcf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:42.773310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-230822e7-9cda-40d0-b423-79696b5bcfcf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:42.850934 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0ff571a9-2811-4cd2-b184-3a106143b1a8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:42.861820 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-0ff571a9-2811-4cd2-b184-3a106143b1a8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1523 microversion: 2.1 time: 0.160749 Aug 04 21:42:42.877827 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 198/398] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:42 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:42.886110 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-743a5327-f955-49c9-af1d-db2c33d0a2b7 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:42.888198 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-743a5327-f955-49c9-af1d-db2c33d0a2b7 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:42.908340 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-743a5327-f955-49c9-af1d-db2c33d0a2b7 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:42.912234 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-743a5327-f955-49c9-af1d-db2c33d0a2b7 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:42.912855 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-743a5327-f955-49c9-af1d-db2c33d0a2b7 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:42.913742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-743a5327-f955-49c9-af1d-db2c33d0a2b7 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:42.916101 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-743a5327-f955-49c9-af1d-db2c33d0a2b7 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:42.921873 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-743a5327-f955-49c9-af1d-db2c33d0a2b7 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:42.960654 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=100 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:42:43.049146 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-230822e7-9cda-40d0-b423-79696b5bcfcf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:43.063072 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-230822e7-9cda-40d0-b423-79696b5bcfcf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1503 microversion: 2.1 time: 0.303160 Aug 04 21:42:43.063656 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 201/399] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:42 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1503 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:43.228191 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-743a5327-f955-49c9-af1d-db2c33d0a2b7 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:43.238645 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-743a5327-f955-49c9-af1d-db2c33d0a2b7 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1315 microversion: 2.1 time: 0.356851 Aug 04 21:42:43.239400 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 199/400] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:42 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:43.304257 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-4ec0494b-38ae-4f2a-bafe-c939b0810f7f tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:43.304923 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-4ec0494b-38ae-4f2a-bafe-c939b0810f7f tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:43.315791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4ec0494b-38ae-4f2a-bafe-c939b0810f7f tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:43.316565 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4ec0494b-38ae-4f2a-bafe-c939b0810f7f tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:43.319945 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4ec0494b-38ae-4f2a-bafe-c939b0810f7f tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:43.327020 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4ec0494b-38ae-4f2a-bafe-c939b0810f7f tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:43.331441 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4ec0494b-38ae-4f2a-bafe-c939b0810f7f tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:43.332535 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4ec0494b-38ae-4f2a-bafe-c939b0810f7f tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:43.440727 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4ec0494b-38ae-4f2a-bafe-c939b0810f7f tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:43.450143 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-4ec0494b-38ae-4f2a-bafe-c939b0810f7f tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1346 microversion: 2.1 time: 0.150720 Aug 04 21:42:43.450957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 202/401] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:43 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1346 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:43.809103 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-fba6499b-d61b-4143-9eb6-35fa9c73cb4f req-57bee6f0-2574-4882-be3d-4fc65edf9ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a1d1620-92e5-471d-9845-d3c256391b0b", "name": "network-vif-deleted", "tag": "e9fe7799-ea7c-41c5-9742-76dce429671e"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:42:43.819593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-fba6499b-d61b-4143-9eb6-35fa9c73cb4f req-57bee6f0-2574-4882-be3d-4fc65edf9ff4 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:43.820055 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-fba6499b-d61b-4143-9eb6-35fa9c73cb4f req-57bee6f0-2574-4882-be3d-4fc65edf9ff4 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:43.820601 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-fba6499b-d61b-4143-9eb6-35fa9c73cb4f req-57bee6f0-2574-4882-be3d-4fc65edf9ff4 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:43.833298 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-fba6499b-d61b-4143-9eb6-35fa9c73cb4f req-57bee6f0-2574-4882-be3d-4fc65edf9ff4 service nova] Creating event network-vif-deleted:e9fe7799-ea7c-41c5-9742-76dce429671e for instance 8a1d1620-92e5-471d-9845-d3c256391b0b on hv-cinder-85220 Aug 04 21:42:43.839268 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-fba6499b-d61b-4143-9eb6-35fa9c73cb4f req-57bee6f0-2574-4882-be3d-4fc65edf9ff4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033727 Aug 04 21:42:43.839849 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 200/402] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:42:43.892305 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-120a47b2-8fc1-4acd-99ea-27adeabc3a56 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:43.892916 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-120a47b2-8fc1-4acd-99ea-27adeabc3a56 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:43.903660 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-120a47b2-8fc1-4acd-99ea-27adeabc3a56 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:43.904066 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-120a47b2-8fc1-4acd-99ea-27adeabc3a56 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:43.904503 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-120a47b2-8fc1-4acd-99ea-27adeabc3a56 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:43.905209 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-120a47b2-8fc1-4acd-99ea-27adeabc3a56 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:43.905657 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-120a47b2-8fc1-4acd-99ea-27adeabc3a56 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:43.906104 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-120a47b2-8fc1-4acd-99ea-27adeabc3a56 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:44.085753 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e5beb78f-9521-42b0-900b-331ca8d39c70 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:44.086997 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e5beb78f-9521-42b0-900b-331ca8d39c70 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:44.093554 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e5beb78f-9521-42b0-900b-331ca8d39c70 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:44.094313 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e5beb78f-9521-42b0-900b-331ca8d39c70 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:44.094849 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e5beb78f-9521-42b0-900b-331ca8d39c70 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:44.095777 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e5beb78f-9521-42b0-900b-331ca8d39c70 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:44.096341 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e5beb78f-9521-42b0-900b-331ca8d39c70 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:44.097002 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e5beb78f-9521-42b0-900b-331ca8d39c70 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:44.197369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e5beb78f-9521-42b0-900b-331ca8d39c70 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:44.205453 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e5beb78f-9521-42b0-900b-331ca8d39c70 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1297 microversion: 2.1 time: 0.124252 Aug 04 21:42:44.212844 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-120a47b2-8fc1-4acd-99ea-27adeabc3a56 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:44.219489 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 201/403] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:44 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1297 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:44.221629 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-120a47b2-8fc1-4acd-99ea-27adeabc3a56 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1503 microversion: 2.1 time: 0.342598 Aug 04 21:42:44.222480 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 203/404] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:43 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1503 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:44.244923 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d6d5e987-654e-4138-9809-fa6274de23bb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:44.245531 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d6d5e987-654e-4138-9809-fa6274de23bb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:44.252842 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d6d5e987-654e-4138-9809-fa6274de23bb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:44.252842 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d6d5e987-654e-4138-9809-fa6274de23bb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:44.253207 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d6d5e987-654e-4138-9809-fa6274de23bb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:44.253981 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d6d5e987-654e-4138-9809-fa6274de23bb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:44.254739 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d6d5e987-654e-4138-9809-fa6274de23bb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:44.255173 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d6d5e987-654e-4138-9809-fa6274de23bb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:44.275011 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-5cfad5fa-80ca-4780-a2fb-b7a2096e6a2f tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:44.275621 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-5cfad5fa-80ca-4780-a2fb-b7a2096e6a2f tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:44.287407 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5cfad5fa-80ca-4780-a2fb-b7a2096e6a2f tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:44.290654 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5cfad5fa-80ca-4780-a2fb-b7a2096e6a2f tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:44.291158 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5cfad5fa-80ca-4780-a2fb-b7a2096e6a2f tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:44.291932 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5cfad5fa-80ca-4780-a2fb-b7a2096e6a2f tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:44.292566 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5cfad5fa-80ca-4780-a2fb-b7a2096e6a2f tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:44.293154 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5cfad5fa-80ca-4780-a2fb-b7a2096e6a2f tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:44.430177 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d6d5e987-654e-4138-9809-fa6274de23bb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:44.465332 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d6d5e987-654e-4138-9809-fa6274de23bb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1516 microversion: 2.1 time: 0.218296 Aug 04 21:42:44.465332 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 202/405] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:44 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1516 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:44.486188 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-815de69f-e681-435d-850c-7cec9bb28e78 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:44.486808 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-815de69f-e681-435d-850c-7cec9bb28e78 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:44.496548 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-815de69f-e681-435d-850c-7cec9bb28e78 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:44.497048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-815de69f-e681-435d-850c-7cec9bb28e78 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:44.497484 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-815de69f-e681-435d-850c-7cec9bb28e78 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:44.498534 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-815de69f-e681-435d-850c-7cec9bb28e78 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:44.499432 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-815de69f-e681-435d-850c-7cec9bb28e78 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:44.501288 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-815de69f-e681-435d-850c-7cec9bb28e78 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:44.537600 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5cfad5fa-80ca-4780-a2fb-b7a2096e6a2f tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:44.541710 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-815de69f-e681-435d-850c-7cec9bb28e78 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:44.542355 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-815de69f-e681-435d-850c-7cec9bb28e78 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:44.542910 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-815de69f-e681-435d-850c-7cec9bb28e78 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:44.543614 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-815de69f-e681-435d-850c-7cec9bb28e78 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lazy-loading 'fault' on Instance uuid 80b3cb09-2341-45b6-85aa-26706dd17e65 {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:42:44.548344 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-5cfad5fa-80ca-4780-a2fb-b7a2096e6a2f tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1315 microversion: 2.1 time: 0.277440 Aug 04 21:42:44.549345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 204/406] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:44 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:44.599274 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-815de69f-e681-435d-850c-7cec9bb28e78 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd681a6cc3e5247c9bb2537a6cacb7dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c113838ba92441c89e4447d7d567b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:44.609234 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-815de69f-e681-435d-850c-7cec9bb28e78 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 200 len: 1351 microversion: 2.1 time: 0.127589 Aug 04 21:42:44.610719 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 203/407] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:44 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 1351 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:44.938796 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-45845346-19b4-48c7-a285-7a4ba880ed0c req-49c13e58-9560-4620-abb4-8fedadb71de3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5366ddc3-6224-49fe-a320-1fd0e9e1b4b3", "tag": "8d2e4daf-515c-4f04-ae97-fce1c150fc31"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:42:44.952018 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-45845346-19b4-48c7-a285-7a4ba880ed0c req-49c13e58-9560-4620-abb4-8fedadb71de3 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:44.952843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-45845346-19b4-48c7-a285-7a4ba880ed0c req-49c13e58-9560-4620-abb4-8fedadb71de3 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:44.953499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-45845346-19b4-48c7-a285-7a4ba880ed0c req-49c13e58-9560-4620-abb4-8fedadb71de3 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:44.966063 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-45845346-19b4-48c7-a285-7a4ba880ed0c req-49c13e58-9560-4620-abb4-8fedadb71de3 service nova] Creating event network-changed:8d2e4daf-515c-4f04-ae97-fce1c150fc31 for instance 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 on hv-cinder-85220 Aug 04 21:42:44.971220 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-45845346-19b4-48c7-a285-7a4ba880ed0c req-49c13e58-9560-4620-abb4-8fedadb71de3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041682 Aug 04 21:42:44.971805 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 205/408] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:42:45.237014 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-3d33a13b-5ec5-4d2b-b961-872b50ca5ddf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:45.237014 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-3d33a13b-5ec5-4d2b-b961-872b50ca5ddf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:45.237014 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d33a13b-5ec5-4d2b-b961-872b50ca5ddf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:45.237014 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d33a13b-5ec5-4d2b-b961-872b50ca5ddf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:45.237896 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d33a13b-5ec5-4d2b-b961-872b50ca5ddf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:45.237896 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d33a13b-5ec5-4d2b-b961-872b50ca5ddf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:45.237896 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d33a13b-5ec5-4d2b-b961-872b50ca5ddf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:45.237896 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d33a13b-5ec5-4d2b-b961-872b50ca5ddf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:45.267928 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d33a13b-5ec5-4d2b-b961-872b50ca5ddf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:45.268406 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d33a13b-5ec5-4d2b-b961-872b50ca5ddf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:45.268839 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d33a13b-5ec5-4d2b-b961-872b50ca5ddf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:45.269280 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-3d33a13b-5ec5-4d2b-b961-872b50ca5ddf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lazy-loading 'fault' on Instance uuid 8a1d1620-92e5-471d-9845-d3c256391b0b {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:42:45.315443 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-3d33a13b-5ec5-4d2b-b961-872b50ca5ddf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:45.324222 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-3d33a13b-5ec5-4d2b-b961-872b50ca5ddf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 200 len: 1302 microversion: 2.1 time: 0.101161 Aug 04 21:42:45.324986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 204/409] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:45 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 1302 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:45.571123 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f554dadc-1ac3-4765-9f4b-97d5f6c5d788 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:45.573143 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-f554dadc-1ac3-4765-9f4b-97d5f6c5d788 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:45.580573 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f554dadc-1ac3-4765-9f4b-97d5f6c5d788 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:45.592970 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f554dadc-1ac3-4765-9f4b-97d5f6c5d788 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:45.594880 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f554dadc-1ac3-4765-9f4b-97d5f6c5d788 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:45.595691 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f554dadc-1ac3-4765-9f4b-97d5f6c5d788 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:45.596159 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f554dadc-1ac3-4765-9f4b-97d5f6c5d788 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:45.596589 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f554dadc-1ac3-4765-9f4b-97d5f6c5d788 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:45.633317 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-04ff0337-05e5-43b7-8374-b601d3e404ce tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:45.634847 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-04ff0337-05e5-43b7-8374-b601d3e404ce tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:45.652055 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-04ff0337-05e5-43b7-8374-b601d3e404ce tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:45.657787 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-04ff0337-05e5-43b7-8374-b601d3e404ce tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:45.657787 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-04ff0337-05e5-43b7-8374-b601d3e404ce tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:45.657787 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-04ff0337-05e5-43b7-8374-b601d3e404ce tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:45.657787 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-04ff0337-05e5-43b7-8374-b601d3e404ce tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:45.658196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-04ff0337-05e5-43b7-8374-b601d3e404ce tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:45.677425 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-04ff0337-05e5-43b7-8374-b601d3e404ce tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] HTTP exception thrown: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. Aug 04 21:42:45.684514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-04ff0337-05e5-43b7-8374-b601d3e404ce tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Request method failure captured: Aug 04 21:42:45.684514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 HTTP/1.1 Aug 04 21:42:45.684514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:42:45.684514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:42:45.684514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:42:45.684514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:42:45.684514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:42:45.684514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:42:45.684514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:42:45.684514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:42:45.684514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7DzPYE21dX0FW5E-D-ViqEVIK_VuQOWWmKq5sj-0JURgLhl4Oc4bfP7bv1rPyr8ka_-RTItu3PS18QlqS9MzvwwvU3Qq8RKQIUBvOB5Waq2H49ZUkJm9oqvrTUbRZWZAEozK3hxNGhkTBzFS1-2yqqDzAl_lyVJVGYFJwC0lmWUPa_E Aug 04 21:42:45.684514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:42:45.684514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:42:45.684514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:42:45.684514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:42:45.684514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:42:45.684514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:42:45.684514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: 4c113838ba92441c89e4447d7d567b31 Aug 04 21:42:45.684514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-DeleteServersTestJSON-555798337 Aug 04 21:42:45.684514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:42:45.684514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:42:45.686129 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4c113838ba92441c89e4447d7d567b31", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4c113838ba92441c89e4447d7d567b31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4c113838ba92441c89e4447d7d567b31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4c113838ba92441c89e4447d7d567b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:42:45.686129 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-DeleteServersTestJSON-555798337 Aug 04 21:42:45.686129 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: 4c113838ba92441c89e4447d7d567b31 Aug 04 21:42:45.686129 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-DeleteServersTestJSON-555798337 Aug 04 21:42:45.686129 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-DeleteServersTestJSON-555798337-project Aug 04 21:42:45.686129 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:42:45.686129 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:42:45.686129 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: d681a6cc3e5247c9bb2537a6cacb7dd4 Aug 04 21:42:45.686129 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-DeleteServersTestJSON-555798337-project Aug 04 21:42:45.686129 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:42:45.686129 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. Aug 04 21:42:45.686129 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': '80b3cb09-2341-45b6-85aa-26706dd17e65'} Aug 04 21:42:45.686936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:42:45.686936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:42:45.686936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:42:45.686936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:42:45.686936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:42:45.686936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:42:45.686936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:42:45.686936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:42:45.686936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:42:45.686936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:42:45.686936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. Aug 04 21:42:45.686936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:42:45.686936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:42:45.686936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:42:45.686936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:42:45.686936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:42:45.686936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:42:45.686936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:42:45.686936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:42:45.686936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:42:45.688135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:42:45.688135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:42:45.688135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:42:45.688135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:42:45.688135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:42:45.688135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:42:45.688135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:42:45.688135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. Aug 04 21:42:45.688135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:42:45.688135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:42:45.688135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:42:45.688135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:42:45.688135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:42:45.688135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:42:45.688135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:42:45.688135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:42:45.688135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. Aug 04 21:42:45.688135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:42:45.689171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-04ff0337-05e5-43b7-8374-b601d3e404ce tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Returning 404 to user: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:42:45.689171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-04ff0337-05e5-43b7-8374-b601d3e404ce tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 404 len: 111 microversion: 2.1 time: 0.057193 Aug 04 21:42:45.693967 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 205/410] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:45 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:42:45.834376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-38b1d421-ee0a-4bbb-8592-6047176b4a9d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:45.836786 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-38b1d421-ee0a-4bbb-8592-6047176b4a9d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:45.842985 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-38b1d421-ee0a-4bbb-8592-6047176b4a9d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:45.843531 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-38b1d421-ee0a-4bbb-8592-6047176b4a9d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:45.843963 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-38b1d421-ee0a-4bbb-8592-6047176b4a9d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:45.844653 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-38b1d421-ee0a-4bbb-8592-6047176b4a9d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:45.845096 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-38b1d421-ee0a-4bbb-8592-6047176b4a9d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:45.845512 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-38b1d421-ee0a-4bbb-8592-6047176b4a9d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:45.860140 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-38b1d421-ee0a-4bbb-8592-6047176b4a9d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] HTTP exception thrown: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. Aug 04 21:42:45.861974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-38b1d421-ee0a-4bbb-8592-6047176b4a9d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Request method failure captured: Aug 04 21:42:45.861974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65/os-volume_attachments HTTP/1.1 Aug 04 21:42:45.861974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:42:45.861974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:42:45.861974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:42:45.861974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:42:45.861974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:42:45.861974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:42:45.861974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:42:45.861974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:42:45.861974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7DzPYE21dX0FW5E-D-ViqEVIK_VuQOWWmKq5sj-0JURgLhl4Oc4bfP7bv1rPyr8ka_-RTItu3PS18QlqS9MzvwwvU3Qq8RKQIUBvOB5Waq2H49ZUkJm9oqvrTUbRZWZAEozK3hxNGhkTBzFS1-2yqqDzAl_lyVJVGYFJwC0lmWUPa_E Aug 04 21:42:45.861974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:42:45.861974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:42:45.861974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:42:45.861974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:42:45.861974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:42:45.861974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:42:45.861974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: 4c113838ba92441c89e4447d7d567b31 Aug 04 21:42:45.861974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-DeleteServersTestJSON-555798337 Aug 04 21:42:45.861974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:42:45.861974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:42:45.863542 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4c113838ba92441c89e4447d7d567b31", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4c113838ba92441c89e4447d7d567b31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4c113838ba92441c89e4447d7d567b31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4c113838ba92441c89e4447d7d567b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:42:45.863542 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-DeleteServersTestJSON-555798337 Aug 04 21:42:45.863542 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: 4c113838ba92441c89e4447d7d567b31 Aug 04 21:42:45.863542 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-DeleteServersTestJSON-555798337 Aug 04 21:42:45.863542 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-DeleteServersTestJSON-555798337-project Aug 04 21:42:45.863542 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:42:45.863542 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:42:45.863542 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: d681a6cc3e5247c9bb2537a6cacb7dd4 Aug 04 21:42:45.863542 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-DeleteServersTestJSON-555798337-project Aug 04 21:42:45.863542 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:42:45.863542 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. Aug 04 21:42:45.863542 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'server_id': '80b3cb09-2341-45b6-85aa-26706dd17e65'} Aug 04 21:42:45.864240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:42:45.864240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:42:45.864240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:42:45.864240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:42:45.864240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:42:45.864240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:42:45.864240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:42:45.864240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:42:45.864240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:42:45.864240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:42:45.864240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. Aug 04 21:42:45.864240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:42:45.864240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:42:45.864240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:42:45.864240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:42:45.864240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:42:45.864240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:42:45.864240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:42:45.864240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:42:45.864240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:42:45.866143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:42:45.866143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 21:42:45.866143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:42:45.866143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 21:42:45.866143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:42:45.866143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 04 21:42:45.866143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 04 21:42:45.866143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:42:45.866143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:42:45.866143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. Aug 04 21:42:45.866143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:42:45.866143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:42:45.866143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:42:45.866143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:42:45.866143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:42:45.866143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:42:45.866143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:42:45.866143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:42:45.866143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. Aug 04 21:42:45.866143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:42:45.867318 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-38b1d421-ee0a-4bbb-8592-6047176b4a9d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Returning 404 to user: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:42:45.867318 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-38b1d421-ee0a-4bbb-8592-6047176b4a9d tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033433 Aug 04 21:42:45.867318 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 206/411] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:42:45 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:42:45.879786 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f554dadc-1ac3-4765-9f4b-97d5f6c5d788 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:45.893796 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f554dadc-1ac3-4765-9f4b-97d5f6c5d788 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1315 microversion: 2.1 time: 0.327472 Aug 04 21:42:45.906359 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 206/412] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:45 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:46.346320 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-16cce43a-f72c-4476-8aa4-6ccc80344a98 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:46.347282 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-16cce43a-f72c-4476-8aa4-6ccc80344a98 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 8a1d1620-92e5-471d-9845-d3c256391b0b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:46.354654 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-16cce43a-f72c-4476-8aa4-6ccc80344a98 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:46.355219 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-16cce43a-f72c-4476-8aa4-6ccc80344a98 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:46.355664 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-16cce43a-f72c-4476-8aa4-6ccc80344a98 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:46.356377 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-16cce43a-f72c-4476-8aa4-6ccc80344a98 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:46.356821 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-16cce43a-f72c-4476-8aa4-6ccc80344a98 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:46.357237 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-16cce43a-f72c-4476-8aa4-6ccc80344a98 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:46.372316 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-16cce43a-f72c-4476-8aa4-6ccc80344a98 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] HTTP exception thrown: Instance 8a1d1620-92e5-471d-9845-d3c256391b0b could not be found. Aug 04 21:42:46.375176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-16cce43a-f72c-4476-8aa4-6ccc80344a98 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Request method failure captured: Aug 04 21:42:46.375176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b HTTP/1.1 Aug 04 21:42:46.375176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:42:46.375176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:42:46.375176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:42:46.375176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:42:46.375176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:42:46.375176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:42:46.375176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:42:46.375176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:42:46.375176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7D0Udel8S0r7HhCNpVLJRu1OvxRapn-o3SLOcAmLAOL6hxCCZ9lODdKmshaEnN31E6PpiWwcne83PlJienyyS-RGt3w1oM-itfBenOOIP_luDAI_8FVUDnbtNQCwvJeGCHNON2mHySh6HdR36lNRTdVsPUSwIfriGjY1Vo4V7Y3MpmQ Aug 04 21:42:46.375176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:42:46.375176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:42:46.375176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:42:46.375176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:42:46.375176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:42:46.375176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:42:46.375176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: b37a8c7b37ac4f8d9711ac8cd0e37f02 Aug 04 21:42:46.375176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-VolumesActionsTest-1913954289 Aug 04 21:42:46.375176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:42:46.375176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:42:46.376666 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b37a8c7b37ac4f8d9711ac8cd0e37f02", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b37a8c7b37ac4f8d9711ac8cd0e37f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b37a8c7b37ac4f8d9711ac8cd0e37f02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b37a8c7b37ac4f8d9711ac8cd0e37f02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:42:46.376666 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-VolumesActionsTest-1913954289 Aug 04 21:42:46.376666 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: b37a8c7b37ac4f8d9711ac8cd0e37f02 Aug 04 21:42:46.376666 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-VolumesActionsTest-1913954289 Aug 04 21:42:46.376666 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-VolumesActionsTest-1913954289-project Aug 04 21:42:46.376666 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:42:46.376666 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:42:46.376666 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: db4a45e9f40740c99cc49d9f2978332d Aug 04 21:42:46.376666 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-VolumesActionsTest-1913954289-project Aug 04 21:42:46.376666 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:42:46.376666 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance 8a1d1620-92e5-471d-9845-d3c256391b0b could not be found. Aug 04 21:42:46.376666 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': '8a1d1620-92e5-471d-9845-d3c256391b0b'} Aug 04 21:42:46.377582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:42:46.377582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:42:46.377582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:42:46.377582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:42:46.377582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:42:46.377582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:42:46.377582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:42:46.377582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:42:46.377582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:42:46.377582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:42:46.377582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a1d1620-92e5-471d-9845-d3c256391b0b could not be found. Aug 04 21:42:46.377582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:42:46.377582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:42:46.377582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:42:46.377582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:42:46.377582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:42:46.377582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:42:46.377582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:42:46.377582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:42:46.377582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:42:46.378824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:42:46.378824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:42:46.378824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:42:46.378824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:42:46.378824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:42:46.378824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:42:46.378824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:42:46.378824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a1d1620-92e5-471d-9845-d3c256391b0b could not be found. Aug 04 21:42:46.378824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:42:46.378824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:42:46.378824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:42:46.378824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:42:46.378824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:42:46.378824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:42:46.378824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:42:46.378824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:42:46.378824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a1d1620-92e5-471d-9845-d3c256391b0b could not be found. Aug 04 21:42:46.378824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:42:46.379971 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-16cce43a-f72c-4476-8aa4-6ccc80344a98 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Returning 404 to user: Instance 8a1d1620-92e5-471d-9845-d3c256391b0b could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:42:46.379971 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-16cce43a-f72c-4476-8aa4-6ccc80344a98 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b" status: 404 len: 111 microversion: 2.1 time: 0.033014 Aug 04 21:42:46.379971 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 207/413] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:46 2022] GET /compute/v2.1/servers/8a1d1620-92e5-471d-9845-d3c256391b0b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:42:46.498495 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-bd664672-ea44-4716-8eb3-ebb47c63605c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1824437913", "imageRef": "fca0c9ba-fb0a-4f30-932f-84d5253674ad", "flavorRef": "452", "networks": [{"uuid": "0a5dd67a-0f5d-448f-908c-876c4f749a33"}]}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:42:46.507317 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:42:46.559067 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.network.neutron [None req-bd664672-ea44-4716-8eb3-ebb47c63605c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] validate_networks() for [('0a5dd67a-0f5d-448f-908c-876c4f749a33', None, None, None, None, None)] {{(pid=136341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:42:46.917107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-701b0e01-b09a-4a62-9cba-4477cd7aee3b tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:46.917713 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-701b0e01-b09a-4a62-9cba-4477cd7aee3b tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:46.922331 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-bd664672-ea44-4716-8eb3-ebb47c63605c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Flavor limits 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:42:46.922850 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-bd664672-ea44-4716-8eb3-ebb47c63605c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Image limits 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:42:46.923210 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-bd664672-ea44-4716-8eb3-ebb47c63605c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Flavor pref 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:42:46.923622 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-bd664672-ea44-4716-8eb3-ebb47c63605c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Image pref 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:42:46.924006 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-bd664672-ea44-4716-8eb3-ebb47c63605c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:42:46.924291 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-701b0e01-b09a-4a62-9cba-4477cd7aee3b tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:46.924781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-701b0e01-b09a-4a62-9cba-4477cd7aee3b tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:46.925255 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-701b0e01-b09a-4a62-9cba-4477cd7aee3b tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:46.925999 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-701b0e01-b09a-4a62-9cba-4477cd7aee3b tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:46.926472 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-701b0e01-b09a-4a62-9cba-4477cd7aee3b tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:46.927483 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-701b0e01-b09a-4a62-9cba-4477cd7aee3b tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:46.933407 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bd664672-ea44-4716-8eb3-ebb47c63605c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:46.933879 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bd664672-ea44-4716-8eb3-ebb47c63605c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:46.934337 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bd664672-ea44-4716-8eb3-ebb47c63605c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:46.935047 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bd664672-ea44-4716-8eb3-ebb47c63605c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:46.935489 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bd664672-ea44-4716-8eb3-ebb47c63605c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:46.935901 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bd664672-ea44-4716-8eb3-ebb47c63605c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:46.952634 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-bd664672-ea44-4716-8eb3-ebb47c63605c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Getting quotas for project b37a8c7b37ac4f8d9711ac8cd0e37f02. Resources: {'instances', 'cores', 'ram'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:42:46.956562 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-bd664672-ea44-4716-8eb3-ebb47c63605c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Getting quotas for user db4a45e9f40740c99cc49d9f2978332d and project b37a8c7b37ac4f8d9711ac8cd0e37f02. Resources: {'instances', 'cores', 'ram'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:42:46.967705 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-bd664672-ea44-4716-8eb3-ebb47c63605c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Going to run 1 instances... {{(pid=136341) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:42:46.969997 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-bd664672-ea44-4716-8eb3-ebb47c63605c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca0c9ba-fb0a-4f30-932f-84d5253674ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:42:47.068186 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-701b0e01-b09a-4a62-9cba-4477cd7aee3b tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:47.072016 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-701b0e01-b09a-4a62-9cba-4477cd7aee3b tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1315 microversion: 2.1 time: 0.158762 Aug 04 21:42:47.072576 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 208/414] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:46 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:47.100548 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-bd664672-ea44-4716-8eb3-ebb47c63605c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605747 Aug 04 21:42:47.101282 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 207/415] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 4 21:42:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:42:47.111960 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ccf112d0-d69a-4b93-bd91-6f4b34206c59 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:47.112649 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ccf112d0-d69a-4b93-bd91-6f4b34206c59 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:47.182929 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ccf112d0-d69a-4b93-bd91-6f4b34206c59 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:47.186289 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ccf112d0-d69a-4b93-bd91-6f4b34206c59 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1214 microversion: 2.1 time: 0.078011 Aug 04 21:42:47.186934 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 209/416] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:47 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:47.308355 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2f6d35de-61ba-4ce8-9a82-7f2746d578e1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:47.308849 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-2f6d35de-61ba-4ce8-9a82-7f2746d578e1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:47.317093 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f6d35de-61ba-4ce8-9a82-7f2746d578e1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:47.318280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f6d35de-61ba-4ce8-9a82-7f2746d578e1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:47.322191 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f6d35de-61ba-4ce8-9a82-7f2746d578e1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:47.322191 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f6d35de-61ba-4ce8-9a82-7f2746d578e1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:47.322191 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f6d35de-61ba-4ce8-9a82-7f2746d578e1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:47.322191 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f6d35de-61ba-4ce8-9a82-7f2746d578e1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:47.334183 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-2f6d35de-61ba-4ce8-9a82-7f2746d578e1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] HTTP exception thrown: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. Aug 04 21:42:47.338870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2f6d35de-61ba-4ce8-9a82-7f2746d578e1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Request method failure captured: Aug 04 21:42:47.338870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: DELETE /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 HTTP/1.1 Aug 04 21:42:47.338870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:42:47.338870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:42:47.338870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:42:47.338870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 21:42:47.338870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:42:47.338870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:42:47.338870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:42:47.338870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:42:47.338870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7DzPYE21dX0FW5E-D-ViqEVIK_VuQOWWmKq5sj-0JURgLhl4Oc4bfP7bv1rPyr8ka_-RTItu3PS18QlqS9MzvwwvU3Qq8RKQIUBvOB5Waq2H49ZUkJm9oqvrTUbRZWZAEozK3hxNGhkTBzFS1-2yqqDzAl_lyVJVGYFJwC0lmWUPa_E Aug 04 21:42:47.338870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:42:47.338870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:42:47.338870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:42:47.338870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:42:47.338870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:42:47.338870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:42:47.338870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: 4c113838ba92441c89e4447d7d567b31 Aug 04 21:42:47.338870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-DeleteServersTestJSON-555798337 Aug 04 21:42:47.338870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:42:47.338870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:42:47.340490 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4c113838ba92441c89e4447d7d567b31", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4c113838ba92441c89e4447d7d567b31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4c113838ba92441c89e4447d7d567b31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4c113838ba92441c89e4447d7d567b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:42:47.340490 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-DeleteServersTestJSON-555798337 Aug 04 21:42:47.340490 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: 4c113838ba92441c89e4447d7d567b31 Aug 04 21:42:47.340490 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-DeleteServersTestJSON-555798337 Aug 04 21:42:47.340490 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-DeleteServersTestJSON-555798337-project Aug 04 21:42:47.340490 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:42:47.340490 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:42:47.340490 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: d681a6cc3e5247c9bb2537a6cacb7dd4 Aug 04 21:42:47.340490 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-DeleteServersTestJSON-555798337-project Aug 04 21:42:47.340490 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 21:42:47.340490 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. Aug 04 21:42:47.340490 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': '80b3cb09-2341-45b6-85aa-26706dd17e65'} Aug 04 21:42:47.341242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:42:47.341242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:42:47.341242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:42:47.341242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:42:47.341242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:42:47.341242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:42:47.341242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:42:47.341242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:42:47.341242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:42:47.341242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:42:47.341242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. Aug 04 21:42:47.341242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:42:47.341242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:42:47.341242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:42:47.341242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:42:47.341242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:42:47.341242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:42:47.341242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:42:47.341242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:42:47.341242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:42:47.345807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:42:47.345807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:42:47.345807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:42:47.345807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:42:47.345807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:42:47.345807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:42:47.345807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:42:47.345807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:42:47.345807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:42:47.345807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. Aug 04 21:42:47.345807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:42:47.345807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:42:47.345807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:42:47.345807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:42:47.345807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:42:47.345807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:42:47.345807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:42:47.345807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:42:47.345807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. Aug 04 21:42:47.345807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:42:47.347923 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2f6d35de-61ba-4ce8-9a82-7f2746d578e1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Returning 404 to user: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:42:47.347923 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2f6d35de-61ba-4ce8-9a82-7f2746d578e1 tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "DELETE /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 404 len: 111 microversion: 2.1 time: 0.035871 Aug 04 21:42:47.347923 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 208/417] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:42:47 2022] DELETE /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:42:47.351429 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8dbb7a65-b541-468c-a1be-8fa35d19c46b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:47.352197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8dbb7a65-b541-468c-a1be-8fa35d19c46b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] [instance: 80b3cb09-2341-45b6-85aa-26706dd17e65] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:47.358508 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8dbb7a65-b541-468c-a1be-8fa35d19c46b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:47.358992 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8dbb7a65-b541-468c-a1be-8fa35d19c46b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:47.359426 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8dbb7a65-b541-468c-a1be-8fa35d19c46b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:47.360124 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8dbb7a65-b541-468c-a1be-8fa35d19c46b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:47.360659 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8dbb7a65-b541-468c-a1be-8fa35d19c46b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:47.361079 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8dbb7a65-b541-468c-a1be-8fa35d19c46b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:47.532925 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-8dbb7a65-b541-468c-a1be-8fa35d19c46b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] HTTP exception thrown: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. Aug 04 21:42:47.534452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8dbb7a65-b541-468c-a1be-8fa35d19c46b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Request method failure captured: Aug 04 21:42:47.534452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 HTTP/1.1 Aug 04 21:42:47.534452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:42:47.534452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:42:47.534452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:42:47.534452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:42:47.534452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:42:47.534452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:42:47.534452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:42:47.534452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:42:47.534452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7DzPYE21dX0FW5E-D-ViqEVIK_VuQOWWmKq5sj-0JURgLhl4Oc4bfP7bv1rPyr8ka_-RTItu3PS18QlqS9MzvwwvU3Qq8RKQIUBvOB5Waq2H49ZUkJm9oqvrTUbRZWZAEozK3hxNGhkTBzFS1-2yqqDzAl_lyVJVGYFJwC0lmWUPa_E Aug 04 21:42:47.534452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:42:47.534452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:42:47.534452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:42:47.534452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:42:47.534452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:42:47.534452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:42:47.534452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: 4c113838ba92441c89e4447d7d567b31 Aug 04 21:42:47.534452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-DeleteServersTestJSON-555798337 Aug 04 21:42:47.534452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:42:47.534452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:42:47.535959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4c113838ba92441c89e4447d7d567b31", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4c113838ba92441c89e4447d7d567b31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4c113838ba92441c89e4447d7d567b31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4c113838ba92441c89e4447d7d567b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:42:47.535959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-DeleteServersTestJSON-555798337 Aug 04 21:42:47.535959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: 4c113838ba92441c89e4447d7d567b31 Aug 04 21:42:47.535959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-DeleteServersTestJSON-555798337 Aug 04 21:42:47.535959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-DeleteServersTestJSON-555798337-project Aug 04 21:42:47.535959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:42:47.535959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:42:47.535959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: d681a6cc3e5247c9bb2537a6cacb7dd4 Aug 04 21:42:47.535959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-DeleteServersTestJSON-555798337-project Aug 04 21:42:47.535959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:42:47.535959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. Aug 04 21:42:47.535959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': '80b3cb09-2341-45b6-85aa-26706dd17e65'} Aug 04 21:42:47.537634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:42:47.537634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:42:47.537634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:42:47.537634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:42:47.537634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:42:47.537634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:42:47.537634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:42:47.537634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:42:47.537634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:42:47.537634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:42:47.537634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. Aug 04 21:42:47.537634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:42:47.537634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:42:47.537634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:42:47.537634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:42:47.537634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:42:47.537634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:42:47.537634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:42:47.537634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:42:47.537634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:42:47.538781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:42:47.538781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:42:47.538781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:42:47.538781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:42:47.538781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:42:47.538781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:42:47.538781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:42:47.538781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. Aug 04 21:42:47.538781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:42:47.538781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:42:47.538781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:42:47.538781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:42:47.538781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:42:47.538781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:42:47.538781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:42:47.538781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:42:47.538781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. Aug 04 21:42:47.538781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:42:47.539748 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8dbb7a65-b541-468c-a1be-8fa35d19c46b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] Returning 404 to user: Instance 80b3cb09-2341-45b6-85aa-26706dd17e65 could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:42:47.539748 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8dbb7a65-b541-468c-a1be-8fa35d19c46b tempest-DeleteServersTestJSON-555798337 tempest-DeleteServersTestJSON-555798337-project] 10.222.0.73 "GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65" status: 404 len: 111 microversion: 2.1 time: 0.189350 Aug 04 21:42:47.539748 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 210/418] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:47 2022] GET /compute/v2.1/servers/80b3cb09-2341-45b6-85aa-26706dd17e65 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:42:47.673097 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e8cfb17a-a3a1-412c-8001-fd91fb658bd2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:42:47.675466 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e8cfb17a-a3a1-412c-8001-fd91fb658bd2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:47.683248 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e8cfb17a-a3a1-412c-8001-fd91fb658bd2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:47.683967 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e8cfb17a-a3a1-412c-8001-fd91fb658bd2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:47.684569 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e8cfb17a-a3a1-412c-8001-fd91fb658bd2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:47.685306 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e8cfb17a-a3a1-412c-8001-fd91fb658bd2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:47.685743 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e8cfb17a-a3a1-412c-8001-fd91fb658bd2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:47.686358 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e8cfb17a-a3a1-412c-8001-fd91fb658bd2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:47.690265 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:42:47.710021 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.objects.instance [None req-e8cfb17a-a3a1-412c-8001-fd91fb658bd2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lazy-loading 'flavor' on Instance uuid cf234f88-9a79-4880-92c5-4d2a1c1c379f {{(pid=136341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:42:48.025974 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e8cfb17a-a3a1-412c-8001-fd91fb658bd2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "POST /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f/action" status: 200 len: 32 microversion: 2.1 time: 0.357102 Aug 04 21:42:48.027250 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 209/419] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 4 21:42:47 2022] POST /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f/action => generated 32 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 21:42:48.039672 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-0947570c-d07d-49f5-810f-ee2fff0d9b4f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:48.040897 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-0947570c-d07d-49f5-810f-ee2fff0d9b4f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:48.042851 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:42:48.048074 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0947570c-d07d-49f5-810f-ee2fff0d9b4f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:48.048847 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0947570c-d07d-49f5-810f-ee2fff0d9b4f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:48.049368 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0947570c-d07d-49f5-810f-ee2fff0d9b4f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:48.050233 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0947570c-d07d-49f5-810f-ee2fff0d9b4f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:48.050774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0947570c-d07d-49f5-810f-ee2fff0d9b4f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:48.051285 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0947570c-d07d-49f5-810f-ee2fff0d9b4f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:48.093276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-10f79d66-91a7-4f04-a95c-9901b7362609 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:48.094202 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-10f79d66-91a7-4f04-a95c-9901b7362609 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:48.101150 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-10f79d66-91a7-4f04-a95c-9901b7362609 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:48.101638 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-10f79d66-91a7-4f04-a95c-9901b7362609 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:48.102197 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-10f79d66-91a7-4f04-a95c-9901b7362609 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:48.102799 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-10f79d66-91a7-4f04-a95c-9901b7362609 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:48.103254 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-10f79d66-91a7-4f04-a95c-9901b7362609 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:48.103682 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-10f79d66-91a7-4f04-a95c-9901b7362609 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:48.245919 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-10f79d66-91a7-4f04-a95c-9901b7362609 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:48.260383 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-10f79d66-91a7-4f04-a95c-9901b7362609 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1315 microversion: 2.1 time: 0.170630 Aug 04 21:42:48.260897 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 210/420] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:48 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:48.274165 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b45ac740-aa78-4729-99a9-cfc28f680bfd tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:48.274165 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b45ac740-aa78-4729-99a9-cfc28f680bfd tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:48.277788 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b45ac740-aa78-4729-99a9-cfc28f680bfd tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:48.277788 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b45ac740-aa78-4729-99a9-cfc28f680bfd tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:48.277788 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b45ac740-aa78-4729-99a9-cfc28f680bfd tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:48.277788 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b45ac740-aa78-4729-99a9-cfc28f680bfd tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:48.278132 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b45ac740-aa78-4729-99a9-cfc28f680bfd tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:48.278132 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b45ac740-aa78-4729-99a9-cfc28f680bfd tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:48.330954 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0947570c-d07d-49f5-810f-ee2fff0d9b4f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:48.335834 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-0947570c-d07d-49f5-810f-ee2fff0d9b4f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1522 microversion: 2.1 time: 0.301326 Aug 04 21:42:48.336636 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 211/421] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:48 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:48.365333 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b45ac740-aa78-4729-99a9-cfc28f680bfd tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:48.367875 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b45ac740-aa78-4729-99a9-cfc28f680bfd tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1218 microversion: 2.1 time: 0.105978 Aug 04 21:42:48.368441 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 211/422] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:48 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:49.291475 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-055e8fe9-4631-4a59-821b-561af53425fd tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:49.294178 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-055e8fe9-4631-4a59-821b-561af53425fd tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:49.306745 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-055e8fe9-4631-4a59-821b-561af53425fd tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:49.306745 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-055e8fe9-4631-4a59-821b-561af53425fd tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:49.306745 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-055e8fe9-4631-4a59-821b-561af53425fd tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:49.306745 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-055e8fe9-4631-4a59-821b-561af53425fd tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:49.307262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-055e8fe9-4631-4a59-821b-561af53425fd tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:49.307262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-055e8fe9-4631-4a59-821b-561af53425fd tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:49.356685 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-569c5878-1ee6-4d10-b7d1-5379c175a881 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:49.357445 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-569c5878-1ee6-4d10-b7d1-5379c175a881 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:49.365511 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-569c5878-1ee6-4d10-b7d1-5379c175a881 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:49.366404 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-569c5878-1ee6-4d10-b7d1-5379c175a881 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:49.367073 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-569c5878-1ee6-4d10-b7d1-5379c175a881 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:49.368042 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-569c5878-1ee6-4d10-b7d1-5379c175a881 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:49.368961 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-569c5878-1ee6-4d10-b7d1-5379c175a881 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:49.369590 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-569c5878-1ee6-4d10-b7d1-5379c175a881 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:49.636484 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-055e8fe9-4631-4a59-821b-561af53425fd tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:49.645307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-055e8fe9-4631-4a59-821b-561af53425fd tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1315 microversion: 2.1 time: 0.361980 Aug 04 21:42:49.649077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 212/423] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:49 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:49.658952 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-cdcbe607-9700-41a5-a756-7d5553d6ac8d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:49.660434 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-cdcbe607-9700-41a5-a756-7d5553d6ac8d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:49.682992 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cdcbe607-9700-41a5-a756-7d5553d6ac8d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:49.685458 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cdcbe607-9700-41a5-a756-7d5553d6ac8d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:49.685922 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cdcbe607-9700-41a5-a756-7d5553d6ac8d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:49.686692 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cdcbe607-9700-41a5-a756-7d5553d6ac8d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:49.687157 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cdcbe607-9700-41a5-a756-7d5553d6ac8d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:49.687584 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cdcbe607-9700-41a5-a756-7d5553d6ac8d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:49.750296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-569c5878-1ee6-4d10-b7d1-5379c175a881 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:49.759575 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-569c5878-1ee6-4d10-b7d1-5379c175a881 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1522 microversion: 2.1 time: 0.406649 Aug 04 21:42:49.774749 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 212/424] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:49 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:49.784243 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-cdcbe607-9700-41a5-a756-7d5553d6ac8d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:49.797715 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-cdcbe607-9700-41a5-a756-7d5553d6ac8d tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1210 microversion: 2.1 time: 0.146263 Aug 04 21:42:49.798323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 213/425] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:49 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1210 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:50.673152 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-5ccfdf1e-e12a-49f8-949f-99780ad15658 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:50.673763 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-5ccfdf1e-e12a-49f8-949f-99780ad15658 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:50.680850 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5ccfdf1e-e12a-49f8-949f-99780ad15658 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:50.681389 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5ccfdf1e-e12a-49f8-949f-99780ad15658 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:50.681837 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5ccfdf1e-e12a-49f8-949f-99780ad15658 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:50.682568 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5ccfdf1e-e12a-49f8-949f-99780ad15658 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:50.683025 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5ccfdf1e-e12a-49f8-949f-99780ad15658 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:50.683536 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5ccfdf1e-e12a-49f8-949f-99780ad15658 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:50.782314 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-93feaeeb-4368-4f94-9c4a-51e1a1a87355 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:50.784216 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-93feaeeb-4368-4f94-9c4a-51e1a1a87355 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:50.791330 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-93feaeeb-4368-4f94-9c4a-51e1a1a87355 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:50.792064 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-93feaeeb-4368-4f94-9c4a-51e1a1a87355 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:50.792649 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-93feaeeb-4368-4f94-9c4a-51e1a1a87355 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:50.793613 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-93feaeeb-4368-4f94-9c4a-51e1a1a87355 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:50.794261 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-93feaeeb-4368-4f94-9c4a-51e1a1a87355 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:50.794855 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-93feaeeb-4368-4f94-9c4a-51e1a1a87355 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:50.998778 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-93feaeeb-4368-4f94-9c4a-51e1a1a87355 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:51.010237 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-93feaeeb-4368-4f94-9c4a-51e1a1a87355 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1522 microversion: 2.1 time: 0.229836 Aug 04 21:42:51.019128 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5ccfdf1e-e12a-49f8-949f-99780ad15658 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:51.022782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 214/426] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:50 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:51.028037 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a62cdb90-74e4-49de-a08b-c6c52f182f2c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:51.028911 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-a62cdb90-74e4-49de-a08b-c6c52f182f2c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:51.031027 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-5ccfdf1e-e12a-49f8-949f-99780ad15658 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1315 microversion: 2.1 time: 0.361638 Aug 04 21:42:51.031854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 213/427] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:50 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:51.036881 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a62cdb90-74e4-49de-a08b-c6c52f182f2c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:51.036881 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a62cdb90-74e4-49de-a08b-c6c52f182f2c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:51.038344 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a62cdb90-74e4-49de-a08b-c6c52f182f2c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:51.039136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a62cdb90-74e4-49de-a08b-c6c52f182f2c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:51.039645 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a62cdb90-74e4-49de-a08b-c6c52f182f2c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:51.040137 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a62cdb90-74e4-49de-a08b-c6c52f182f2c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:51.112786 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-a62cdb90-74e4-49de-a08b-c6c52f182f2c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:51.121775 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-a62cdb90-74e4-49de-a08b-c6c52f182f2c tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1274 microversion: 2.1 time: 0.097545 Aug 04 21:42:51.122618 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 215/428] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:51 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:52.031898 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c9d50a08-acb0-4a26-9535-c1c6e0fba939 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:52.033198 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c9d50a08-acb0-4a26-9535-c1c6e0fba939 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:52.041412 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9d50a08-acb0-4a26-9535-c1c6e0fba939 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:52.041902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9d50a08-acb0-4a26-9535-c1c6e0fba939 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:52.049251 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9d50a08-acb0-4a26-9535-c1c6e0fba939 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:52.049251 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9d50a08-acb0-4a26-9535-c1c6e0fba939 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:52.049251 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9d50a08-acb0-4a26-9535-c1c6e0fba939 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:52.049251 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9d50a08-acb0-4a26-9535-c1c6e0fba939 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:52.055074 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-c809970f-692b-49c7-81af-588279d6274d tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:52.055673 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-c809970f-692b-49c7-81af-588279d6274d tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:52.062108 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c809970f-692b-49c7-81af-588279d6274d tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:52.062710 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c809970f-692b-49c7-81af-588279d6274d tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:52.063508 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c809970f-692b-49c7-81af-588279d6274d tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:52.064356 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c809970f-692b-49c7-81af-588279d6274d tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:52.065035 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c809970f-692b-49c7-81af-588279d6274d tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:52.065767 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c809970f-692b-49c7-81af-588279d6274d tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:52.270430 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-c9d50a08-acb0-4a26-9535-c1c6e0fba939 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:52.289744 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c9d50a08-acb0-4a26-9535-c1c6e0fba939 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1522 microversion: 2.1 time: 0.265057 Aug 04 21:42:52.307115 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 214/429] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:52 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:52.307115 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-08867fb3-c640-488f-86dc-a5fb7d0b1716 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:52.307115 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-08867fb3-c640-488f-86dc-a5fb7d0b1716 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:52.307115 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-08867fb3-c640-488f-86dc-a5fb7d0b1716 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:52.307115 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-08867fb3-c640-488f-86dc-a5fb7d0b1716 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:52.307574 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-08867fb3-c640-488f-86dc-a5fb7d0b1716 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:52.308285 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-08867fb3-c640-488f-86dc-a5fb7d0b1716 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:52.308729 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-08867fb3-c640-488f-86dc-a5fb7d0b1716 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:52.309496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-08867fb3-c640-488f-86dc-a5fb7d0b1716 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:52.358212 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-c809970f-692b-49c7-81af-588279d6274d tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:52.369440 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-c809970f-692b-49c7-81af-588279d6274d tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1315 microversion: 2.1 time: 0.318065 Aug 04 21:42:52.370720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 216/430] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:52 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:52.384654 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-b3541997-5703-4549-bc16-00bd14b182e9 req-f551c34f-eb25-448c-a3fa-15a6edd821fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5366ddc3-6224-49fe-a320-1fd0e9e1b4b3", "name": "network-vif-plugged", "status": "completed", "tag": "8d2e4daf-515c-4f04-ae97-fce1c150fc31"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:42:52.394936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-b3541997-5703-4549-bc16-00bd14b182e9 req-f551c34f-eb25-448c-a3fa-15a6edd821fa service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:52.395434 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-b3541997-5703-4549-bc16-00bd14b182e9 req-f551c34f-eb25-448c-a3fa-15a6edd821fa service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:52.395871 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-b3541997-5703-4549-bc16-00bd14b182e9 req-f551c34f-eb25-448c-a3fa-15a6edd821fa service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:52.407521 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-b3541997-5703-4549-bc16-00bd14b182e9 req-f551c34f-eb25-448c-a3fa-15a6edd821fa service nova] Creating event network-vif-plugged:8d2e4daf-515c-4f04-ae97-fce1c150fc31 for instance 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 on hv-cinder-85220 Aug 04 21:42:52.413583 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-b3541997-5703-4549-bc16-00bd14b182e9 req-f551c34f-eb25-448c-a3fa-15a6edd821fa service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037709 Aug 04 21:42:52.414664 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 217/431] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:42:52.612952 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-08867fb3-c640-488f-86dc-a5fb7d0b1716 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:52.621471 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-08867fb3-c640-488f-86dc-a5fb7d0b1716 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1314 microversion: 2.1 time: 0.330081 Aug 04 21:42:52.622063 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 215/432] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:52 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:53.044926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-3a7035b8-0b99-4589-bb00-23a99ad4ab0d req-3e2adab2-9263-4671-bcbe-0ea760230f79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ae5df4a-c421-427c-abf7-7b22ba2bae5b", "tag": "e77ac054-2f03-4ade-b8d9-ce7c960c09d8"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:42:53.055194 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-3a7035b8-0b99-4589-bb00-23a99ad4ab0d req-3e2adab2-9263-4671-bcbe-0ea760230f79 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:53.055802 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-3a7035b8-0b99-4589-bb00-23a99ad4ab0d req-3e2adab2-9263-4671-bcbe-0ea760230f79 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:53.056070 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-3a7035b8-0b99-4589-bb00-23a99ad4ab0d req-3e2adab2-9263-4671-bcbe-0ea760230f79 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:53.066509 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-3a7035b8-0b99-4589-bb00-23a99ad4ab0d req-3e2adab2-9263-4671-bcbe-0ea760230f79 service nova] Creating event network-changed:e77ac054-2f03-4ade-b8d9-ce7c960c09d8 for instance 4ae5df4a-c421-427c-abf7-7b22ba2bae5b on hv-cinder-85220 Aug 04 21:42:53.071095 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-3a7035b8-0b99-4589-bb00-23a99ad4ab0d req-3e2adab2-9263-4671-bcbe-0ea760230f79 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030261 Aug 04 21:42:53.071837 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 218/433] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:42:53.313681 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-8db62087-3f8d-455f-ac2c-de239e33f8d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:53.314314 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-8db62087-3f8d-455f-ac2c-de239e33f8d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:53.322463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8db62087-3f8d-455f-ac2c-de239e33f8d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:53.322975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8db62087-3f8d-455f-ac2c-de239e33f8d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:53.323649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8db62087-3f8d-455f-ac2c-de239e33f8d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:53.324527 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8db62087-3f8d-455f-ac2c-de239e33f8d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:53.324976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8db62087-3f8d-455f-ac2c-de239e33f8d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:53.325391 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8db62087-3f8d-455f-ac2c-de239e33f8d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:53.391813 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a9f37419-867f-440b-8c00-434ee7cf86c5 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:53.392576 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-a9f37419-867f-440b-8c00-434ee7cf86c5 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:53.399151 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a9f37419-867f-440b-8c00-434ee7cf86c5 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:53.400488 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a9f37419-867f-440b-8c00-434ee7cf86c5 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:53.400937 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a9f37419-867f-440b-8c00-434ee7cf86c5 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:53.401813 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a9f37419-867f-440b-8c00-434ee7cf86c5 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:53.402398 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a9f37419-867f-440b-8c00-434ee7cf86c5 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:53.402826 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a9f37419-867f-440b-8c00-434ee7cf86c5 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:53.467847 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8db62087-3f8d-455f-ac2c-de239e33f8d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:53.476995 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-8db62087-3f8d-455f-ac2c-de239e33f8d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1522 microversion: 2.1 time: 0.167758 Aug 04 21:42:53.477781 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 216/434] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:53 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:53.548176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-a9f37419-867f-440b-8c00-434ee7cf86c5 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:53.558576 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-a9f37419-867f-440b-8c00-434ee7cf86c5 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1315 microversion: 2.1 time: 0.170590 Aug 04 21:42:53.559489 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 219/435] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:53 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:53.643372 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-72c1195f-820f-4b09-8312-3125bc9302bf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:53.644052 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-72c1195f-820f-4b09-8312-3125bc9302bf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:53.650994 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-72c1195f-820f-4b09-8312-3125bc9302bf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:53.655188 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-72c1195f-820f-4b09-8312-3125bc9302bf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:53.655188 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-72c1195f-820f-4b09-8312-3125bc9302bf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:53.655188 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-72c1195f-820f-4b09-8312-3125bc9302bf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:53.655188 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-72c1195f-820f-4b09-8312-3125bc9302bf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:53.655574 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-72c1195f-820f-4b09-8312-3125bc9302bf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:53.800355 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-72c1195f-820f-4b09-8312-3125bc9302bf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:53.813075 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-72c1195f-820f-4b09-8312-3125bc9302bf tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1314 microversion: 2.1 time: 0.173443 Aug 04 21:42:53.813646 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 217/436] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:53 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:54.498394 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-5fb6e342-5c65-4632-8bf2-95cf7185ce7a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:54.498992 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-5fb6e342-5c65-4632-8bf2-95cf7185ce7a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:54.505855 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5fb6e342-5c65-4632-8bf2-95cf7185ce7a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:54.506293 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5fb6e342-5c65-4632-8bf2-95cf7185ce7a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:54.506720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5fb6e342-5c65-4632-8bf2-95cf7185ce7a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:54.507405 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5fb6e342-5c65-4632-8bf2-95cf7185ce7a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:54.507849 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5fb6e342-5c65-4632-8bf2-95cf7185ce7a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:54.508264 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5fb6e342-5c65-4632-8bf2-95cf7185ce7a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:54.580322 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-eb2ec463-bc4e-4240-ba55-d16b95543ed4 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:54.581520 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-eb2ec463-bc4e-4240-ba55-d16b95543ed4 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:54.589423 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-eb2ec463-bc4e-4240-ba55-d16b95543ed4 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:54.589868 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-eb2ec463-bc4e-4240-ba55-d16b95543ed4 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:54.590663 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-eb2ec463-bc4e-4240-ba55-d16b95543ed4 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:54.591358 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-eb2ec463-bc4e-4240-ba55-d16b95543ed4 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:54.591804 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-eb2ec463-bc4e-4240-ba55-d16b95543ed4 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:54.592219 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-eb2ec463-bc4e-4240-ba55-d16b95543ed4 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:54.663947 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-5fb6e342-5c65-4632-8bf2-95cf7185ce7a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:54.671467 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-5fb6e342-5c65-4632-8bf2-95cf7185ce7a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1522 microversion: 2.1 time: 0.177032 Aug 04 21:42:54.672017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 220/437] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:54 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:54.732020 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-eb2ec463-bc4e-4240-ba55-d16b95543ed4 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:54.740136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-eb2ec463-bc4e-4240-ba55-d16b95543ed4 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1315 microversion: 2.1 time: 0.164122 Aug 04 21:42:54.740702 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 218/438] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:54 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:54.837867 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-eabe839c-7d94-457d-a9c8-607c5f7949a3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:54.838578 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-eabe839c-7d94-457d-a9c8-607c5f7949a3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:54.844774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eabe839c-7d94-457d-a9c8-607c5f7949a3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:54.845258 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eabe839c-7d94-457d-a9c8-607c5f7949a3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:54.845687 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eabe839c-7d94-457d-a9c8-607c5f7949a3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:54.846414 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eabe839c-7d94-457d-a9c8-607c5f7949a3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:54.846861 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eabe839c-7d94-457d-a9c8-607c5f7949a3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:54.847282 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eabe839c-7d94-457d-a9c8-607c5f7949a3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:54.852400 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=100 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:42:54.993280 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-eabe839c-7d94-457d-a9c8-607c5f7949a3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:55.002629 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-eabe839c-7d94-457d-a9c8-607c5f7949a3 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1314 microversion: 2.1 time: 0.171755 Aug 04 21:42:55.003339 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 221/439] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:54 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:55.693579 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e421f6c5-cb2b-4253-a0ed-3d8f8e5c2f33 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:55.694233 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e421f6c5-cb2b-4253-a0ed-3d8f8e5c2f33 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:55.700670 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e421f6c5-cb2b-4253-a0ed-3d8f8e5c2f33 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:55.701158 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e421f6c5-cb2b-4253-a0ed-3d8f8e5c2f33 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:55.701596 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e421f6c5-cb2b-4253-a0ed-3d8f8e5c2f33 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:55.702318 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e421f6c5-cb2b-4253-a0ed-3d8f8e5c2f33 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:55.702771 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e421f6c5-cb2b-4253-a0ed-3d8f8e5c2f33 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:55.706362 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e421f6c5-cb2b-4253-a0ed-3d8f8e5c2f33 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:55.761489 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-60c1abea-3fe4-4a5a-9842-779e20760ff1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:55.762275 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-60c1abea-3fe4-4a5a-9842-779e20760ff1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:55.768768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-60c1abea-3fe4-4a5a-9842-779e20760ff1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:55.769440 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-60c1abea-3fe4-4a5a-9842-779e20760ff1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:55.769866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-60c1abea-3fe4-4a5a-9842-779e20760ff1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:55.770749 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-60c1abea-3fe4-4a5a-9842-779e20760ff1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:55.771201 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-60c1abea-3fe4-4a5a-9842-779e20760ff1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:55.771619 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-60c1abea-3fe4-4a5a-9842-779e20760ff1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:55.835502 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e421f6c5-cb2b-4253-a0ed-3d8f8e5c2f33 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:55.843479 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e421f6c5-cb2b-4253-a0ed-3d8f8e5c2f33 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1522 microversion: 2.1 time: 0.154624 Aug 04 21:42:55.844083 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 219/440] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:55 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:55.903036 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-60c1abea-3fe4-4a5a-9842-779e20760ff1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:55.910471 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-60c1abea-3fe4-4a5a-9842-779e20760ff1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1463 microversion: 2.1 time: 0.153017 Aug 04 21:42:55.911445 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 222/441] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:55 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1463 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:42:55.957216 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-fb9d2fb5-fda6-4c98-b06e-c11102c6d5ab tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:55.957777 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-fb9d2fb5-fda6-4c98-b06e-c11102c6d5ab tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:55.964180 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fb9d2fb5-fda6-4c98-b06e-c11102c6d5ab tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:55.964655 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fb9d2fb5-fda6-4c98-b06e-c11102c6d5ab tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:55.965108 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fb9d2fb5-fda6-4c98-b06e-c11102c6d5ab tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:55.965789 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fb9d2fb5-fda6-4c98-b06e-c11102c6d5ab tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:55.966289 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fb9d2fb5-fda6-4c98-b06e-c11102c6d5ab tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:55.966704 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fb9d2fb5-fda6-4c98-b06e-c11102c6d5ab tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:55.991604 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-fb9d2fb5-fda6-4c98-b06e-c11102c6d5ab tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Going to try to terminate instance {{(pid=136341) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:42:56.028906 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-aea4704e-c257-4b42-b780-513f6e01fcc4 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:56.029619 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-aea4704e-c257-4b42-b780-513f6e01fcc4 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:56.035927 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aea4704e-c257-4b42-b780-513f6e01fcc4 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:56.036797 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aea4704e-c257-4b42-b780-513f6e01fcc4 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:56.037240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aea4704e-c257-4b42-b780-513f6e01fcc4 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:56.038086 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aea4704e-c257-4b42-b780-513f6e01fcc4 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:56.039620 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aea4704e-c257-4b42-b780-513f6e01fcc4 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:56.040062 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aea4704e-c257-4b42-b780-513f6e01fcc4 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:56.185285 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-aea4704e-c257-4b42-b780-513f6e01fcc4 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:56.192657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-aea4704e-c257-4b42-b780-513f6e01fcc4 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1314 microversion: 2.1 time: 0.167966 Aug 04 21:42:56.193415 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 223/442] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:56 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:56.313264 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-fb9d2fb5-fda6-4c98-b06e-c11102c6d5ab tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 204 len: 0 microversion: 2.1 time: 0.359523 Aug 04 21:42:56.314116 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 220/443] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:42:55 2022] DELETE /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:42:56.323132 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-c8a6ff63-c629-4ab0-ae8a-ca8fe5a84ab0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:56.323809 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-c8a6ff63-c629-4ab0-ae8a-ca8fe5a84ab0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:56.329955 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c8a6ff63-c629-4ab0-ae8a-ca8fe5a84ab0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:56.330481 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c8a6ff63-c629-4ab0-ae8a-ca8fe5a84ab0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:56.330914 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c8a6ff63-c629-4ab0-ae8a-ca8fe5a84ab0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:56.331604 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c8a6ff63-c629-4ab0-ae8a-ca8fe5a84ab0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:56.332054 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c8a6ff63-c629-4ab0-ae8a-ca8fe5a84ab0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:56.332472 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c8a6ff63-c629-4ab0-ae8a-ca8fe5a84ab0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:56.466396 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-c8a6ff63-c629-4ab0-ae8a-ca8fe5a84ab0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:56.474573 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-c8a6ff63-c629-4ab0-ae8a-ca8fe5a84ab0 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1469 microversion: 2.1 time: 0.154505 Aug 04 21:42:56.475413 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 224/444] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:56 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:56.865623 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-dfb469e2-1391-4810-8dd3-b113f03e981b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:56.866634 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-dfb469e2-1391-4810-8dd3-b113f03e981b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:56.873830 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dfb469e2-1391-4810-8dd3-b113f03e981b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:56.874286 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dfb469e2-1391-4810-8dd3-b113f03e981b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:56.874727 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dfb469e2-1391-4810-8dd3-b113f03e981b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:56.875402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dfb469e2-1391-4810-8dd3-b113f03e981b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:56.875880 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dfb469e2-1391-4810-8dd3-b113f03e981b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:56.876295 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dfb469e2-1391-4810-8dd3-b113f03e981b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:56.946880 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=2 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:42:56.963130 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=6 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:42:57.011528 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-dfb469e2-1391-4810-8dd3-b113f03e981b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:57.018805 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-dfb469e2-1391-4810-8dd3-b113f03e981b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1522 microversion: 2.1 time: 0.157715 Aug 04 21:42:57.019357 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 221/445] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:56 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:57.213570 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-5bed3b4b-6db0-4c79-9afb-1bb5e1e5f397 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:57.214211 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-5bed3b4b-6db0-4c79-9afb-1bb5e1e5f397 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:57.216470 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=2 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:42:57.221106 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5bed3b4b-6db0-4c79-9afb-1bb5e1e5f397 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:57.221591 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5bed3b4b-6db0-4c79-9afb-1bb5e1e5f397 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:57.222108 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5bed3b4b-6db0-4c79-9afb-1bb5e1e5f397 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:57.222804 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5bed3b4b-6db0-4c79-9afb-1bb5e1e5f397 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:57.223256 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5bed3b4b-6db0-4c79-9afb-1bb5e1e5f397 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:57.224292 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5bed3b4b-6db0-4c79-9afb-1bb5e1e5f397 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:57.356642 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-5bed3b4b-6db0-4c79-9afb-1bb5e1e5f397 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:57.364704 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-5bed3b4b-6db0-4c79-9afb-1bb5e1e5f397 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1314 microversion: 2.1 time: 0.154228 Aug 04 21:42:57.365611 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 225/446] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:57 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:57.496551 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a459996b-2786-4dea-9f89-83b26a6febb5 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:57.497154 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a459996b-2786-4dea-9f89-83b26a6febb5 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:57.503032 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a459996b-2786-4dea-9f89-83b26a6febb5 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:57.503507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a459996b-2786-4dea-9f89-83b26a6febb5 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:57.503936 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a459996b-2786-4dea-9f89-83b26a6febb5 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:57.504680 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a459996b-2786-4dea-9f89-83b26a6febb5 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:57.505206 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a459996b-2786-4dea-9f89-83b26a6febb5 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:57.505782 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a459996b-2786-4dea-9f89-83b26a6febb5 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:57.509718 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:42:57.635312 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a459996b-2786-4dea-9f89-83b26a6febb5 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:57.642722 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a459996b-2786-4dea-9f89-83b26a6febb5 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1469 microversion: 2.1 time: 0.150319 Aug 04 21:42:57.644259 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 222/447] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:57 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1469 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:58.040128 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-98f4d31c-d5df-4c6d-aca3-0d31a79406a3 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:58.040733 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-98f4d31c-d5df-4c6d-aca3-0d31a79406a3 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:58.046719 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-98f4d31c-d5df-4c6d-aca3-0d31a79406a3 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:58.047245 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-98f4d31c-d5df-4c6d-aca3-0d31a79406a3 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:58.047679 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-98f4d31c-d5df-4c6d-aca3-0d31a79406a3 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:58.048361 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-98f4d31c-d5df-4c6d-aca3-0d31a79406a3 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:58.048815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-98f4d31c-d5df-4c6d-aca3-0d31a79406a3 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:58.049234 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-98f4d31c-d5df-4c6d-aca3-0d31a79406a3 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:58.182672 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-98f4d31c-d5df-4c6d-aca3-0d31a79406a3 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:58.189954 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-98f4d31c-d5df-4c6d-aca3-0d31a79406a3 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1522 microversion: 2.1 time: 0.154474 Aug 04 21:42:58.190552 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 226/448] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:58 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:58.385302 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-7a4b3ae2-811d-4f12-992e-abff0eac7c61 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:58.385907 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-7a4b3ae2-811d-4f12-992e-abff0eac7c61 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:58.392333 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7a4b3ae2-811d-4f12-992e-abff0eac7c61 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:58.392804 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7a4b3ae2-811d-4f12-992e-abff0eac7c61 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:58.393229 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7a4b3ae2-811d-4f12-992e-abff0eac7c61 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:58.393901 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7a4b3ae2-811d-4f12-992e-abff0eac7c61 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:58.394379 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7a4b3ae2-811d-4f12-992e-abff0eac7c61 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:58.394793 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7a4b3ae2-811d-4f12-992e-abff0eac7c61 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:58.537538 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-7a4b3ae2-811d-4f12-992e-abff0eac7c61 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:58.545803 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-7a4b3ae2-811d-4f12-992e-abff0eac7c61 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1314 microversion: 2.1 time: 0.164608 Aug 04 21:42:58.546571 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 223/449] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:58 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:58.663841 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-897fa98d-be27-4efd-9f89-6ae9b640676d tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:58.664441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-897fa98d-be27-4efd-9f89-6ae9b640676d tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:58.670498 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-897fa98d-be27-4efd-9f89-6ae9b640676d tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:58.670980 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-897fa98d-be27-4efd-9f89-6ae9b640676d tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:58.671420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-897fa98d-be27-4efd-9f89-6ae9b640676d tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:58.672100 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-897fa98d-be27-4efd-9f89-6ae9b640676d tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:58.672554 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-897fa98d-be27-4efd-9f89-6ae9b640676d tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:58.672976 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-897fa98d-be27-4efd-9f89-6ae9b640676d tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:58.805677 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-897fa98d-be27-4efd-9f89-6ae9b640676d tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:58.813551 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-897fa98d-be27-4efd-9f89-6ae9b640676d tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1469 microversion: 2.1 time: 0.153773 Aug 04 21:42:58.814298 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 227/450] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:58 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:59.211617 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-766e713c-860a-4c8a-9abf-0075148246c4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:59.212220 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-766e713c-860a-4c8a-9abf-0075148246c4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:59.219342 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-766e713c-860a-4c8a-9abf-0075148246c4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:59.219834 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-766e713c-860a-4c8a-9abf-0075148246c4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:59.220275 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-766e713c-860a-4c8a-9abf-0075148246c4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:59.221010 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-766e713c-860a-4c8a-9abf-0075148246c4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:59.221514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-766e713c-860a-4c8a-9abf-0075148246c4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:59.221941 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-766e713c-860a-4c8a-9abf-0075148246c4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:59.361433 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-766e713c-860a-4c8a-9abf-0075148246c4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:59.369576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-766e713c-860a-4c8a-9abf-0075148246c4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1522 microversion: 2.1 time: 0.162206 Aug 04 21:42:59.370182 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 224/451] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:59 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:59.569613 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-43b6d6b1-5bba-42b3-b5fb-220c6045f557 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:59.569613 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-43b6d6b1-5bba-42b3-b5fb-220c6045f557 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:59.574377 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-43b6d6b1-5bba-42b3-b5fb-220c6045f557 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:59.574880 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-43b6d6b1-5bba-42b3-b5fb-220c6045f557 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:59.575302 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-43b6d6b1-5bba-42b3-b5fb-220c6045f557 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:59.575982 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-43b6d6b1-5bba-42b3-b5fb-220c6045f557 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:59.576426 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-43b6d6b1-5bba-42b3-b5fb-220c6045f557 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:59.576843 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-43b6d6b1-5bba-42b3-b5fb-220c6045f557 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:59.719478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-43b6d6b1-5bba-42b3-b5fb-220c6045f557 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:59.728721 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-43b6d6b1-5bba-42b3-b5fb-220c6045f557 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1314 microversion: 2.1 time: 0.165220 Aug 04 21:42:59.729264 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 228/452] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:59 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:42:59.837350 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-87fa829f-3516-43c4-a75a-fa0bce9fe851 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:42:59.837937 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-87fa829f-3516-43c4-a75a-fa0bce9fe851 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:42:59.845860 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-87fa829f-3516-43c4-a75a-fa0bce9fe851 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:59.846379 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-87fa829f-3516-43c4-a75a-fa0bce9fe851 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:59.846814 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-87fa829f-3516-43c4-a75a-fa0bce9fe851 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:59.847603 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-87fa829f-3516-43c4-a75a-fa0bce9fe851 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:42:59.851501 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-87fa829f-3516-43c4-a75a-fa0bce9fe851 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:42:59.851501 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-87fa829f-3516-43c4-a75a-fa0bce9fe851 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:42:59.979223 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-87fa829f-3516-43c4-a75a-fa0bce9fe851 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:42:59.986620 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-87fa829f-3516-43c4-a75a-fa0bce9fe851 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1469 microversion: 2.1 time: 0.153671 Aug 04 21:42:59.987175 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 225/453] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:42:59 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:00.391118 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-26974e2e-a8c6-4349-8b84-fd84e595824d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:00.391885 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-26974e2e-a8c6-4349-8b84-fd84e595824d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:00.400873 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-26974e2e-a8c6-4349-8b84-fd84e595824d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:00.401353 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-26974e2e-a8c6-4349-8b84-fd84e595824d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:00.401820 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-26974e2e-a8c6-4349-8b84-fd84e595824d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:00.402545 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-26974e2e-a8c6-4349-8b84-fd84e595824d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:00.402994 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-26974e2e-a8c6-4349-8b84-fd84e595824d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:00.403500 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-26974e2e-a8c6-4349-8b84-fd84e595824d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:00.469756 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-a46aca09-ab3d-4410-9b25-eb41379341d5 req-a9efc879-0cf2-4f1d-bad1-380e5416bd11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae5df4a-c421-427c-abf7-7b22ba2bae5b", "name": "network-vif-plugged", "status": "completed", "tag": "e77ac054-2f03-4ade-b8d9-ce7c960c09d8"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:43:00.481031 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-a46aca09-ab3d-4410-9b25-eb41379341d5 req-a9efc879-0cf2-4f1d-bad1-380e5416bd11 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:00.481732 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-a46aca09-ab3d-4410-9b25-eb41379341d5 req-a9efc879-0cf2-4f1d-bad1-380e5416bd11 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:00.482280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-a46aca09-ab3d-4410-9b25-eb41379341d5 req-a9efc879-0cf2-4f1d-bad1-380e5416bd11 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:00.494435 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-a46aca09-ab3d-4410-9b25-eb41379341d5 req-a9efc879-0cf2-4f1d-bad1-380e5416bd11 service nova] Creating event network-vif-plugged:e77ac054-2f03-4ade-b8d9-ce7c960c09d8 for instance 4ae5df4a-c421-427c-abf7-7b22ba2bae5b on hv-cinder-85220 Aug 04 21:43:00.499473 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-a46aca09-ab3d-4410-9b25-eb41379341d5 req-a9efc879-0cf2-4f1d-bad1-380e5416bd11 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033884 Aug 04 21:43:00.500268 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 226/454] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:43:00.550795 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-26974e2e-a8c6-4349-8b84-fd84e595824d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:00.558159 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-26974e2e-a8c6-4349-8b84-fd84e595824d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1522 microversion: 2.1 time: 0.171089 Aug 04 21:43:00.558745 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 229/455] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:00 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:43:00.750997 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-4005feb0-a0de-4c81-bcce-28fe08a775ff tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:00.751699 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-4005feb0-a0de-4c81-bcce-28fe08a775ff tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:00.758655 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4005feb0-a0de-4c81-bcce-28fe08a775ff tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:00.759137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4005feb0-a0de-4c81-bcce-28fe08a775ff tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:00.759571 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4005feb0-a0de-4c81-bcce-28fe08a775ff tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:00.760257 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4005feb0-a0de-4c81-bcce-28fe08a775ff tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:00.760703 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4005feb0-a0de-4c81-bcce-28fe08a775ff tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:00.761121 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4005feb0-a0de-4c81-bcce-28fe08a775ff tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:00.930736 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4005feb0-a0de-4c81-bcce-28fe08a775ff tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:00.938485 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-4005feb0-a0de-4c81-bcce-28fe08a775ff tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1314 microversion: 2.1 time: 0.191761 Aug 04 21:43:00.939034 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 227/456] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:00 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:01.007811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-59d9971e-287d-4f9b-bf67-d19fd8ff38c3 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:01.008342 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-59d9971e-287d-4f9b-bf67-d19fd8ff38c3 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:01.014823 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-59d9971e-287d-4f9b-bf67-d19fd8ff38c3 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:01.015300 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-59d9971e-287d-4f9b-bf67-d19fd8ff38c3 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:01.015733 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-59d9971e-287d-4f9b-bf67-d19fd8ff38c3 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:01.016418 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-59d9971e-287d-4f9b-bf67-d19fd8ff38c3 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:01.016869 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-59d9971e-287d-4f9b-bf67-d19fd8ff38c3 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:01.017328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-59d9971e-287d-4f9b-bf67-d19fd8ff38c3 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:01.200190 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-59d9971e-287d-4f9b-bf67-d19fd8ff38c3 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:01.209402 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-59d9971e-287d-4f9b-bf67-d19fd8ff38c3 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1469 microversion: 2.1 time: 0.205139 Aug 04 21:43:01.223050 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 230/457] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:01 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1469 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:01.579713 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d959178d-7519-41b1-84b4-1525f126d713 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:01.580368 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-d959178d-7519-41b1-84b4-1525f126d713 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:01.587045 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d959178d-7519-41b1-84b4-1525f126d713 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:01.587534 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d959178d-7519-41b1-84b4-1525f126d713 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:01.587972 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d959178d-7519-41b1-84b4-1525f126d713 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:01.588665 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d959178d-7519-41b1-84b4-1525f126d713 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:01.589299 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d959178d-7519-41b1-84b4-1525f126d713 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:01.589888 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d959178d-7519-41b1-84b4-1525f126d713 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:01.766361 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d959178d-7519-41b1-84b4-1525f126d713 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:01.772454 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d959178d-7519-41b1-84b4-1525f126d713 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1522 microversion: 2.1 time: 0.196542 Aug 04 21:43:01.773022 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 228/458] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:01 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:01.917837 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-f4d7b3d0-bcf9-4b21-bcd5-7b365d1a9671 req-f32ea404-96e5-44d1-b75f-a213824228e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5366ddc3-6224-49fe-a320-1fd0e9e1b4b3", "name": "network-vif-deleted", "tag": "8d2e4daf-515c-4f04-ae97-fce1c150fc31"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:43:01.932815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-f4d7b3d0-bcf9-4b21-bcd5-7b365d1a9671 req-f32ea404-96e5-44d1-b75f-a213824228e7 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:01.933326 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-f4d7b3d0-bcf9-4b21-bcd5-7b365d1a9671 req-f32ea404-96e5-44d1-b75f-a213824228e7 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:01.933781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-f4d7b3d0-bcf9-4b21-bcd5-7b365d1a9671 req-f32ea404-96e5-44d1-b75f-a213824228e7 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:01.948306 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-f4d7b3d0-bcf9-4b21-bcd5-7b365d1a9671 req-f32ea404-96e5-44d1-b75f-a213824228e7 service nova] Creating event network-vif-deleted:8d2e4daf-515c-4f04-ae97-fce1c150fc31 for instance 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 on hv-cinder-85220 Aug 04 21:43:01.953588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-f4d7b3d0-bcf9-4b21-bcd5-7b365d1a9671 req-f32ea404-96e5-44d1-b75f-a213824228e7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039360 Aug 04 21:43:01.954422 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 231/459] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:43:01.961573 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c8f16644-ee23-41af-9c1f-b6708ee58e5a tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:01.962295 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c8f16644-ee23-41af-9c1f-b6708ee58e5a tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:01.968689 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c8f16644-ee23-41af-9c1f-b6708ee58e5a tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:01.969261 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c8f16644-ee23-41af-9c1f-b6708ee58e5a tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:01.969641 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c8f16644-ee23-41af-9c1f-b6708ee58e5a tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:01.970383 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c8f16644-ee23-41af-9c1f-b6708ee58e5a tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:01.970835 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c8f16644-ee23-41af-9c1f-b6708ee58e5a tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:01.971260 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c8f16644-ee23-41af-9c1f-b6708ee58e5a tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:02.110527 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-c8f16644-ee23-41af-9c1f-b6708ee58e5a tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:02.125061 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c8f16644-ee23-41af-9c1f-b6708ee58e5a tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1314 microversion: 2.1 time: 0.162323 Aug 04 21:43:02.125061 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 229/460] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:01 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:02.231305 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-c16ab515-fca1-4239-95fc-8a68ec6d343f tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:02.232039 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-c16ab515-fca1-4239-95fc-8a68ec6d343f tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:02.238155 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c16ab515-fca1-4239-95fc-8a68ec6d343f tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:02.238637 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c16ab515-fca1-4239-95fc-8a68ec6d343f tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:02.239696 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c16ab515-fca1-4239-95fc-8a68ec6d343f tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:02.240423 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c16ab515-fca1-4239-95fc-8a68ec6d343f tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:02.240861 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c16ab515-fca1-4239-95fc-8a68ec6d343f tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:02.241284 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c16ab515-fca1-4239-95fc-8a68ec6d343f tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:02.304696 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-c16ab515-fca1-4239-95fc-8a68ec6d343f tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:02.312090 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-c16ab515-fca1-4239-95fc-8a68ec6d343f tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1427 microversion: 2.1 time: 0.085130 Aug 04 21:43:02.313779 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 232/461] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:02 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:02.794248 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-4ae5763a-c908-46fc-ae9b-478e178ee4f6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:02.794848 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-4ae5763a-c908-46fc-ae9b-478e178ee4f6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:02.801080 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4ae5763a-c908-46fc-ae9b-478e178ee4f6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:02.802365 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4ae5763a-c908-46fc-ae9b-478e178ee4f6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:02.802858 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4ae5763a-c908-46fc-ae9b-478e178ee4f6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:02.803592 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4ae5763a-c908-46fc-ae9b-478e178ee4f6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:02.804038 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4ae5763a-c908-46fc-ae9b-478e178ee4f6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:02.804454 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4ae5763a-c908-46fc-ae9b-478e178ee4f6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:02.933472 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4ae5763a-c908-46fc-ae9b-478e178ee4f6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:02.941214 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-4ae5763a-c908-46fc-ae9b-478e178ee4f6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1522 microversion: 2.1 time: 0.151283 Aug 04 21:43:02.941781 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 230/462] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:02 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:03.143014 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-eec2defb-dc49-40c7-ace7-aa476ca92403 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:03.143553 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-eec2defb-dc49-40c7-ace7-aa476ca92403 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:03.150232 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eec2defb-dc49-40c7-ace7-aa476ca92403 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:03.150715 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eec2defb-dc49-40c7-ace7-aa476ca92403 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:03.151168 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eec2defb-dc49-40c7-ace7-aa476ca92403 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:03.151903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eec2defb-dc49-40c7-ace7-aa476ca92403 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:03.152305 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eec2defb-dc49-40c7-ace7-aa476ca92403 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:03.152745 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eec2defb-dc49-40c7-ace7-aa476ca92403 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:03.287474 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-eec2defb-dc49-40c7-ace7-aa476ca92403 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:03.296119 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-eec2defb-dc49-40c7-ace7-aa476ca92403 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1314 microversion: 2.1 time: 0.155844 Aug 04 21:43:03.297051 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 233/463] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:03 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:03.334319 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-97d9d120-09af-4f28-9b45-44a2b9289cd9 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:03.335003 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-97d9d120-09af-4f28-9b45-44a2b9289cd9 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:03.341669 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-97d9d120-09af-4f28-9b45-44a2b9289cd9 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:03.342167 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-97d9d120-09af-4f28-9b45-44a2b9289cd9 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:03.342596 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-97d9d120-09af-4f28-9b45-44a2b9289cd9 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:03.343273 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-97d9d120-09af-4f28-9b45-44a2b9289cd9 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:03.343714 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-97d9d120-09af-4f28-9b45-44a2b9289cd9 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:03.344127 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-97d9d120-09af-4f28-9b45-44a2b9289cd9 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:03.429370 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-97d9d120-09af-4f28-9b45-44a2b9289cd9 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:03.443852 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-97d9d120-09af-4f28-9b45-44a2b9289cd9 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1427 microversion: 2.1 time: 0.114538 Aug 04 21:43:03.444741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 231/464] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:03 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:03.962055 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-825ad767-e288-4e12-87b7-31a17ed65729 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:03.962663 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-825ad767-e288-4e12-87b7-31a17ed65729 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:03.968483 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-825ad767-e288-4e12-87b7-31a17ed65729 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:03.968942 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-825ad767-e288-4e12-87b7-31a17ed65729 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:03.969367 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-825ad767-e288-4e12-87b7-31a17ed65729 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:03.970066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-825ad767-e288-4e12-87b7-31a17ed65729 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:03.970675 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-825ad767-e288-4e12-87b7-31a17ed65729 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:03.971093 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-825ad767-e288-4e12-87b7-31a17ed65729 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:04.103747 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-825ad767-e288-4e12-87b7-31a17ed65729 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:04.112179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-825ad767-e288-4e12-87b7-31a17ed65729 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1522 microversion: 2.1 time: 0.153887 Aug 04 21:43:04.122044 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 234/465] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:03 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:04.319144 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-6e7fb25e-18d3-491f-9474-fdacd42bfd87 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:04.319802 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-6e7fb25e-18d3-491f-9474-fdacd42bfd87 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:04.326815 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e7fb25e-18d3-491f-9474-fdacd42bfd87 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:04.327283 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e7fb25e-18d3-491f-9474-fdacd42bfd87 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:04.328181 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e7fb25e-18d3-491f-9474-fdacd42bfd87 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:04.328654 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e7fb25e-18d3-491f-9474-fdacd42bfd87 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:04.329098 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e7fb25e-18d3-491f-9474-fdacd42bfd87 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:04.329509 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e7fb25e-18d3-491f-9474-fdacd42bfd87 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:04.464955 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-264eac6f-801b-4d4e-bac4-41a3cdbfcde1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:04.465422 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6e7fb25e-18d3-491f-9474-fdacd42bfd87 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:04.465794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-264eac6f-801b-4d4e-bac4-41a3cdbfcde1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:04.471681 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-264eac6f-801b-4d4e-bac4-41a3cdbfcde1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:04.472098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-264eac6f-801b-4d4e-bac4-41a3cdbfcde1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:04.472527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-264eac6f-801b-4d4e-bac4-41a3cdbfcde1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:04.472766 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-6e7fb25e-18d3-491f-9474-fdacd42bfd87 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1314 microversion: 2.1 time: 0.158854 Aug 04 21:43:04.473924 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-264eac6f-801b-4d4e-bac4-41a3cdbfcde1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:04.474106 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 232/466] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:04 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:04.474576 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-264eac6f-801b-4d4e-bac4-41a3cdbfcde1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:04.474962 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-264eac6f-801b-4d4e-bac4-41a3cdbfcde1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:04.507508 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-264eac6f-801b-4d4e-bac4-41a3cdbfcde1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:04.507981 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-264eac6f-801b-4d4e-bac4-41a3cdbfcde1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:04.508440 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-264eac6f-801b-4d4e-bac4-41a3cdbfcde1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:04.508884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-264eac6f-801b-4d4e-bac4-41a3cdbfcde1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lazy-loading 'fault' on Instance uuid 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:43:04.550067 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-264eac6f-801b-4d4e-bac4-41a3cdbfcde1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:04.558466 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-264eac6f-801b-4d4e-bac4-41a3cdbfcde1 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1305 microversion: 2.1 time: 0.097589 Aug 04 21:43:04.559027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 235/467] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:04 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:43:05.141281 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a687fbfd-e981-4068-a7ea-fed45d7b3f46 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:05.141936 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a687fbfd-e981-4068-a7ea-fed45d7b3f46 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:05.147749 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a687fbfd-e981-4068-a7ea-fed45d7b3f46 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:05.148225 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a687fbfd-e981-4068-a7ea-fed45d7b3f46 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:05.148654 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a687fbfd-e981-4068-a7ea-fed45d7b3f46 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:05.149332 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a687fbfd-e981-4068-a7ea-fed45d7b3f46 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:05.149778 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a687fbfd-e981-4068-a7ea-fed45d7b3f46 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:05.150229 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a687fbfd-e981-4068-a7ea-fed45d7b3f46 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:05.282351 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a687fbfd-e981-4068-a7ea-fed45d7b3f46 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:05.290354 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a687fbfd-e981-4068-a7ea-fed45d7b3f46 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1522 microversion: 2.1 time: 0.153080 Aug 04 21:43:05.290920 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 233/468] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:05 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:05.494063 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-55d13f7b-0122-4578-ba40-cee8f92c5ff8 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:05.495400 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-55d13f7b-0122-4578-ba40-cee8f92c5ff8 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:05.501277 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-55d13f7b-0122-4578-ba40-cee8f92c5ff8 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:05.501761 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-55d13f7b-0122-4578-ba40-cee8f92c5ff8 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:05.502238 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-55d13f7b-0122-4578-ba40-cee8f92c5ff8 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:05.503101 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-55d13f7b-0122-4578-ba40-cee8f92c5ff8 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:05.503766 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-55d13f7b-0122-4578-ba40-cee8f92c5ff8 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:05.504190 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-55d13f7b-0122-4578-ba40-cee8f92c5ff8 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:05.580440 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-62da8659-385e-431e-9edf-ef08769c2d44 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:05.581050 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-62da8659-385e-431e-9edf-ef08769c2d44 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:05.588552 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62da8659-385e-431e-9edf-ef08769c2d44 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:05.589043 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62da8659-385e-431e-9edf-ef08769c2d44 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:05.589477 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62da8659-385e-431e-9edf-ef08769c2d44 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:05.590204 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62da8659-385e-431e-9edf-ef08769c2d44 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:05.590713 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62da8659-385e-431e-9edf-ef08769c2d44 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:05.596069 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62da8659-385e-431e-9edf-ef08769c2d44 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:05.626509 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62da8659-385e-431e-9edf-ef08769c2d44 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:05.626905 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62da8659-385e-431e-9edf-ef08769c2d44 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:05.627658 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62da8659-385e-431e-9edf-ef08769c2d44 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:05.627855 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.objects.instance [None req-62da8659-385e-431e-9edf-ef08769c2d44 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lazy-loading 'fault' on Instance uuid 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 {{(pid=136341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:43:05.653456 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-55d13f7b-0122-4578-ba40-cee8f92c5ff8 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:05.659651 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-55d13f7b-0122-4578-ba40-cee8f92c5ff8 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1499 microversion: 2.1 time: 0.169817 Aug 04 21:43:05.660473 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 236/469] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:05 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1499 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:05.682512 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-62da8659-385e-431e-9edf-ef08769c2d44 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:05.687160 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-62da8659-385e-431e-9edf-ef08769c2d44 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1305 microversion: 2.1 time: 0.110638 Aug 04 21:43:05.687726 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 234/470] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:05 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:43:06.310859 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d5424cda-a39d-4e74-afb7-c81b924d9a8b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:06.311481 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d5424cda-a39d-4e74-afb7-c81b924d9a8b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:06.318248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d5424cda-a39d-4e74-afb7-c81b924d9a8b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:06.318839 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d5424cda-a39d-4e74-afb7-c81b924d9a8b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:06.319274 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d5424cda-a39d-4e74-afb7-c81b924d9a8b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:06.319956 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d5424cda-a39d-4e74-afb7-c81b924d9a8b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:06.320401 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d5424cda-a39d-4e74-afb7-c81b924d9a8b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:06.320820 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d5424cda-a39d-4e74-afb7-c81b924d9a8b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:06.453257 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d5424cda-a39d-4e74-afb7-c81b924d9a8b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:06.462136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d5424cda-a39d-4e74-afb7-c81b924d9a8b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1522 microversion: 2.1 time: 0.154961 Aug 04 21:43:06.462700 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 237/471] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:06 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:06.689849 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-485ae903-a94f-4a1f-8fdf-8474810228ee tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:06.690496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-485ae903-a94f-4a1f-8fdf-8474810228ee tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:06.698067 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-485ae903-a94f-4a1f-8fdf-8474810228ee tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:06.698551 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-485ae903-a94f-4a1f-8fdf-8474810228ee tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:06.698978 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-485ae903-a94f-4a1f-8fdf-8474810228ee tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:06.699690 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-485ae903-a94f-4a1f-8fdf-8474810228ee tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:06.700134 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-485ae903-a94f-4a1f-8fdf-8474810228ee tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:06.700554 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-485ae903-a94f-4a1f-8fdf-8474810228ee tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:06.709707 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2d33a694-f5db-4ed9-b2e8-1c4458caa48e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:06.710496 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2d33a694-f5db-4ed9-b2e8-1c4458caa48e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:06.735230 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2d33a694-f5db-4ed9-b2e8-1c4458caa48e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:06.735358 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-485ae903-a94f-4a1f-8fdf-8474810228ee tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Going to try to terminate instance {{(pid=136341) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:43:06.735478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2d33a694-f5db-4ed9-b2e8-1c4458caa48e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:06.735478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2d33a694-f5db-4ed9-b2e8-1c4458caa48e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:06.735478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2d33a694-f5db-4ed9-b2e8-1c4458caa48e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:06.735478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2d33a694-f5db-4ed9-b2e8-1c4458caa48e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:06.735837 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2d33a694-f5db-4ed9-b2e8-1c4458caa48e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:06.744951 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=100 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:43:06.773461 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2d33a694-f5db-4ed9-b2e8-1c4458caa48e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:06.774059 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2d33a694-f5db-4ed9-b2e8-1c4458caa48e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:06.774702 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2d33a694-f5db-4ed9-b2e8-1c4458caa48e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:06.775144 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-2d33a694-f5db-4ed9-b2e8-1c4458caa48e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lazy-loading 'fault' on Instance uuid 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:43:06.826985 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2d33a694-f5db-4ed9-b2e8-1c4458caa48e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:06.835794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2d33a694-f5db-4ed9-b2e8-1c4458caa48e tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1305 microversion: 2.1 time: 0.130731 Aug 04 21:43:06.836458 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 238/472] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:06 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1305 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:43:06.993256 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-485ae903-a94f-4a1f-8fdf-8474810228ee tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "DELETE /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 204 len: 0 microversion: 2.1 time: 0.307153 Aug 04 21:43:06.994308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 235/473] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:43:06 2022] DELETE /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:43:07.002405 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e9b04593-87ab-498b-ab65-03658e12aefb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:07.006890 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e9b04593-87ab-498b-ab65-03658e12aefb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:07.010110 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e9b04593-87ab-498b-ab65-03658e12aefb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:07.010600 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e9b04593-87ab-498b-ab65-03658e12aefb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:07.011034 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e9b04593-87ab-498b-ab65-03658e12aefb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:07.011735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e9b04593-87ab-498b-ab65-03658e12aefb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:07.012186 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e9b04593-87ab-498b-ab65-03658e12aefb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:07.012608 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e9b04593-87ab-498b-ab65-03658e12aefb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:07.186280 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e9b04593-87ab-498b-ab65-03658e12aefb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:07.193984 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e9b04593-87ab-498b-ab65-03658e12aefb tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1505 microversion: 2.1 time: 0.195678 Aug 04 21:43:07.194577 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 239/474] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:06 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:43:07.485148 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e3a5bacd-d6f1-4ef9-9c91-03f11853c6f9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:07.485950 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e3a5bacd-d6f1-4ef9-9c91-03f11853c6f9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:07.491964 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e3a5bacd-d6f1-4ef9-9c91-03f11853c6f9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:07.492448 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e3a5bacd-d6f1-4ef9-9c91-03f11853c6f9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:07.492876 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e3a5bacd-d6f1-4ef9-9c91-03f11853c6f9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:07.493557 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e3a5bacd-d6f1-4ef9-9c91-03f11853c6f9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:07.494287 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e3a5bacd-d6f1-4ef9-9c91-03f11853c6f9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:07.494711 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e3a5bacd-d6f1-4ef9-9c91-03f11853c6f9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:07.634092 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e3a5bacd-d6f1-4ef9-9c91-03f11853c6f9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:07.641628 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e3a5bacd-d6f1-4ef9-9c91-03f11853c6f9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1502 microversion: 2.1 time: 0.160694 Aug 04 21:43:07.642211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 236/475] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:07 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:07.662845 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-473fe6b6-e222-4f27-8244-0c9ce8f3d40d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "782dba2c-24ce-4d04-9777-f68ece83fbaa"}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:43:07.665270 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-473fe6b6-e222-4f27-8244-0c9ce8f3d40d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:07.671302 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-473fe6b6-e222-4f27-8244-0c9ce8f3d40d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:07.671815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-473fe6b6-e222-4f27-8244-0c9ce8f3d40d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:07.672248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-473fe6b6-e222-4f27-8244-0c9ce8f3d40d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:07.672938 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-473fe6b6-e222-4f27-8244-0c9ce8f3d40d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:07.673407 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-473fe6b6-e222-4f27-8244-0c9ce8f3d40d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:07.673807 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-473fe6b6-e222-4f27-8244-0c9ce8f3d40d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:07.697739 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-473fe6b6-e222-4f27-8244-0c9ce8f3d40d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] HTTP exception thrown: Cannot 'attach_volume' instance cf234f88-9a79-4880-92c5-4d2a1c1c379f while it is in vm_state rescued Aug 04 21:43:07.699369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-473fe6b6-e222-4f27-8244-0c9ce8f3d40d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Request method failure captured: Aug 04 21:43:07.699369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: POST /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f/os-volume_attachments HTTP/1.1 Aug 04 21:43:07.699369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:43:07.699369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:43:07.699369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:43:07.699369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 74 Aug 04 21:43:07.699369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:43:07.699369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:43:07.699369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:43:07.699369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:43:07.699369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7DzPr3cM533Uh9AlWXMHAOzqV7gXVwqd--0bCgLVckarAi2mkz1ojxMjcGyrQ_e6XAF05QDwl9mDP-ttkz96Zi6hf_R9XyiWCakQo1K49Ma92db_R5HUTLJxm7q8GtOr48qzTBtYaspx9TwpgWzcB1mofFXXnH8mJOATCThNeioonFw Aug 04 21:43:07.699369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:43:07.699369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:43:07.699369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:43:07.699369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:43:07.699369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:43:07.699369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:43:07.699369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: 26fb895147494be98bb6ceb8704984b7 Aug 04 21:43:07.699369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1281602055 Aug 04 21:43:07.699369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:43:07.699369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:43:07.700920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_26fb895147494be98bb6ceb8704984b7", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/26fb895147494be98bb6ceb8704984b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/26fb895147494be98bb6ceb8704984b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/26fb895147494be98bb6ceb8704984b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:43:07.700920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1281602055 Aug 04 21:43:07.700920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: 26fb895147494be98bb6ceb8704984b7 Aug 04 21:43:07.700920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1281602055 Aug 04 21:43:07.700920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-ServerRescueNegativeTestJSON-1281602055-project Aug 04 21:43:07.700920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:43:07.700920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:43:07.700920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: d9bc42bec393430b9b3e9399a8c4f95e Aug 04 21:43:07.700920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1281602055-project Aug 04 21:43:07.700920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Aug 04 21:43:07.700920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {"volumeAttachment": {"volumeId": "782dba2c-24ce-4d04-9777-f68ece83fbaa"}} Aug 04 21:43:07.700920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:43:07.701850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Cannot 'attach_volume' instance cf234f88-9a79-4880-92c5-4d2a1c1c379f while it is in vm_state rescued Aug 04 21:43:07.701850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'server_id': 'cf234f88-9a79-4880-92c5-4d2a1c1c379f', 'body': {'volumeAttachment': {'volumeId': '782dba2c-24ce-4d04-9777-f68ece83fbaa'}}} Aug 04 21:43:07.701850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:43:07.701850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:43:07.701850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 21:43:07.701850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 21:43:07.701850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 21:43:07.701850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 21:43:07.701850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 21:43:07.701850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 21:43:07.701850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cf234f88-9a79-4880-92c5-4d2a1c1c379f in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 04 21:43:07.701850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:43:07.701850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:43:07.701850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:43:07.701850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:43:07.701850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:43:07.701850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:43:07.701850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:43:07.701850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:43:07.707167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:43:07.707167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:43:07.707167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:43:07.707167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:43:07.707167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:43:07.707167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:43:07.707167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:43:07.707167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:43:07.707167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 04 21:43:07.707167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 21:43:07.707167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 21:43:07.707167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 21:43:07.707167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance cf234f88-9a79-4880-92c5-4d2a1c1c379f while it is in vm_state rescued Aug 04 21:43:07.707167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:43:07.707167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:43:07.707167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:43:07.707167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:43:07.707167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:43:07.707167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:43:07.708447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:43:07.708447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:43:07.708447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance cf234f88-9a79-4880-92c5-4d2a1c1c379f while it is in vm_state rescued Aug 04 21:43:07.708447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:43:07.708447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-473fe6b6-e222-4f27-8244-0c9ce8f3d40d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Returning 409 to user: Cannot 'attach_volume' instance cf234f88-9a79-4880-92c5-4d2a1c1c379f while it is in vm_state rescued {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:43:07.708447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-473fe6b6-e222-4f27-8244-0c9ce8f3d40d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "POST /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042601 Aug 04 21:43:07.708447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 240/476] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 4 21:43:07 2022] POST /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 21:43:07.710054 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-cc136569-0866-4fd4-8445-d3c3cd9bb33d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:43:07.710587 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-cc136569-0866-4fd4-8445-d3c3cd9bb33d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:07.716842 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cc136569-0866-4fd4-8445-d3c3cd9bb33d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:07.717318 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cc136569-0866-4fd4-8445-d3c3cd9bb33d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:07.717751 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cc136569-0866-4fd4-8445-d3c3cd9bb33d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:07.718458 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cc136569-0866-4fd4-8445-d3c3cd9bb33d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:07.718907 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cc136569-0866-4fd4-8445-d3c3cd9bb33d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:07.719328 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cc136569-0866-4fd4-8445-d3c3cd9bb33d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:07.735941 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:43:07.856762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-259d3644-c906-4e77-ab27-7528b4b13602 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:07.857399 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-259d3644-c906-4e77-ab27-7528b4b13602 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:07.863607 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-259d3644-c906-4e77-ab27-7528b4b13602 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:07.864086 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-259d3644-c906-4e77-ab27-7528b4b13602 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:07.864676 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-259d3644-c906-4e77-ab27-7528b4b13602 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:07.869708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-259d3644-c906-4e77-ab27-7528b4b13602 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:07.869708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-259d3644-c906-4e77-ab27-7528b4b13602 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:07.869708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-259d3644-c906-4e77-ab27-7528b4b13602 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:07.906350 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-259d3644-c906-4e77-ab27-7528b4b13602 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:07.906813 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-259d3644-c906-4e77-ab27-7528b4b13602 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:07.907238 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-259d3644-c906-4e77-ab27-7528b4b13602 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:07.907674 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-259d3644-c906-4e77-ab27-7528b4b13602 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lazy-loading 'fault' on Instance uuid 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:43:07.949162 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-259d3644-c906-4e77-ab27-7528b4b13602 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:07.956691 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-259d3644-c906-4e77-ab27-7528b4b13602 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1305 microversion: 2.1 time: 0.103795 Aug 04 21:43:07.957235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 241/477] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:07 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:43:08.008649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-cc136569-0866-4fd4-8445-d3c3cd9bb33d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "POST /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f/action" status: 202 len: 0 microversion: 2.1 time: 0.302350 Aug 04 21:43:08.009822 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 237/478] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 4 21:43:07 2022] POST /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:43:08.025858 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-90b05728-286c-485f-93d9-6c014c483f95 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:08.026867 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-90b05728-286c-485f-93d9-6c014c483f95 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:08.032528 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-90b05728-286c-485f-93d9-6c014c483f95 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:08.033020 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-90b05728-286c-485f-93d9-6c014c483f95 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:08.033456 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-90b05728-286c-485f-93d9-6c014c483f95 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:08.034187 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-90b05728-286c-485f-93d9-6c014c483f95 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:08.034635 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-90b05728-286c-485f-93d9-6c014c483f95 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:08.035227 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-90b05728-286c-485f-93d9-6c014c483f95 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:08.196274 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-90b05728-286c-485f-93d9-6c014c483f95 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:08.203980 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-90b05728-286c-485f-93d9-6c014c483f95 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1510 microversion: 2.1 time: 0.183593 Aug 04 21:43:08.204513 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 242/479] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:08 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1510 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:08.215710 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-1902d972-3f30-448f-856a-89c65f86d9ad tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:08.218041 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-1902d972-3f30-448f-856a-89c65f86d9ad tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:08.222917 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1902d972-3f30-448f-856a-89c65f86d9ad tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:08.223393 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1902d972-3f30-448f-856a-89c65f86d9ad tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:08.224418 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1902d972-3f30-448f-856a-89c65f86d9ad tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:08.225200 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1902d972-3f30-448f-856a-89c65f86d9ad tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:08.225663 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1902d972-3f30-448f-856a-89c65f86d9ad tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:08.226119 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1902d972-3f30-448f-856a-89c65f86d9ad tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:08.378816 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-1902d972-3f30-448f-856a-89c65f86d9ad tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:08.388027 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-1902d972-3f30-448f-856a-89c65f86d9ad tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1505 microversion: 2.1 time: 0.176931 Aug 04 21:43:08.388598 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 238/480] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:08 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:08.977959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-08c6336f-c8f2-42d0-ba6a-5000a07b6b2c tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:08.978599 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-08c6336f-c8f2-42d0-ba6a-5000a07b6b2c tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:08.984497 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c6336f-c8f2-42d0-ba6a-5000a07b6b2c tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:08.984979 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c6336f-c8f2-42d0-ba6a-5000a07b6b2c tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:08.989449 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c6336f-c8f2-42d0-ba6a-5000a07b6b2c tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:08.989449 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c6336f-c8f2-42d0-ba6a-5000a07b6b2c tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:08.989449 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c6336f-c8f2-42d0-ba6a-5000a07b6b2c tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:08.989449 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c6336f-c8f2-42d0-ba6a-5000a07b6b2c tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:09.018533 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c6336f-c8f2-42d0-ba6a-5000a07b6b2c tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:09.018985 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c6336f-c8f2-42d0-ba6a-5000a07b6b2c tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:09.019497 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c6336f-c8f2-42d0-ba6a-5000a07b6b2c tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:09.019940 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-08c6336f-c8f2-42d0-ba6a-5000a07b6b2c tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lazy-loading 'fault' on Instance uuid 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:43:09.074437 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-08c6336f-c8f2-42d0-ba6a-5000a07b6b2c tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7487daf672c04b1bb052a8a5e4875d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738ce353ad649709334f71983434d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:09.083542 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-08c6336f-c8f2-42d0-ba6a-5000a07b6b2c tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 200 len: 1305 microversion: 2.1 time: 0.109741 Aug 04 21:43:09.084400 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 243/481] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:08 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:09.225267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-82fdfcc7-d8b2-4242-898f-4ff93c8dc60b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:09.225870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-82fdfcc7-d8b2-4242-898f-4ff93c8dc60b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:09.232938 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-82fdfcc7-d8b2-4242-898f-4ff93c8dc60b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:09.233418 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-82fdfcc7-d8b2-4242-898f-4ff93c8dc60b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:09.237871 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-82fdfcc7-d8b2-4242-898f-4ff93c8dc60b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:09.237871 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-82fdfcc7-d8b2-4242-898f-4ff93c8dc60b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:09.237871 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-82fdfcc7-d8b2-4242-898f-4ff93c8dc60b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:09.237871 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-82fdfcc7-d8b2-4242-898f-4ff93c8dc60b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:09.381841 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-82fdfcc7-d8b2-4242-898f-4ff93c8dc60b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:09.389184 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-82fdfcc7-d8b2-4242-898f-4ff93c8dc60b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1510 microversion: 2.1 time: 0.168428 Aug 04 21:43:09.390103 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 239/482] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:09 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:43:09.409841 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-595fcdfc-77ce-475c-8ad9-0851c9ce3344 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:09.410502 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-595fcdfc-77ce-475c-8ad9-0851c9ce3344 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:09.420554 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-595fcdfc-77ce-475c-8ad9-0851c9ce3344 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:09.427390 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-595fcdfc-77ce-475c-8ad9-0851c9ce3344 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:09.427390 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-595fcdfc-77ce-475c-8ad9-0851c9ce3344 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:09.427390 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-595fcdfc-77ce-475c-8ad9-0851c9ce3344 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:09.427390 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-595fcdfc-77ce-475c-8ad9-0851c9ce3344 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:09.427766 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-595fcdfc-77ce-475c-8ad9-0851c9ce3344 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:09.576986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-595fcdfc-77ce-475c-8ad9-0851c9ce3344 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:09.585516 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-595fcdfc-77ce-475c-8ad9-0851c9ce3344 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1505 microversion: 2.1 time: 0.179454 Aug 04 21:43:09.586141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 244/483] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:09 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1505 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:10.105947 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-678ac8c4-c6a3-4b5c-9d92-d683ae941143 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:10.107169 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-678ac8c4-c6a3-4b5c-9d92-d683ae941143 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] [instance: 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:10.114367 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-678ac8c4-c6a3-4b5c-9d92-d683ae941143 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:10.115182 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-678ac8c4-c6a3-4b5c-9d92-d683ae941143 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:10.115631 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-678ac8c4-c6a3-4b5c-9d92-d683ae941143 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:10.116337 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-678ac8c4-c6a3-4b5c-9d92-d683ae941143 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:10.116804 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-678ac8c4-c6a3-4b5c-9d92-d683ae941143 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:10.117394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-678ac8c4-c6a3-4b5c-9d92-d683ae941143 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:10.132908 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-678ac8c4-c6a3-4b5c-9d92-d683ae941143 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] HTTP exception thrown: Instance 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 could not be found. Aug 04 21:43:10.134637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-678ac8c4-c6a3-4b5c-9d92-d683ae941143 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Request method failure captured: Aug 04 21:43:10.134637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 HTTP/1.1 Aug 04 21:43:10.134637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:43:10.134637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:43:10.134637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:43:10.134637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 21:43:10.134637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:43:10.134637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:43:10.134637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:43:10.134637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:43:10.134637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7D1D3OOUAhgNkngPEZP7Bjdgoct6uuCHtwMH_IGgMomkhsuoHPVtFhs8XqTDFUdlOpMMGaYAE-V4nynhoM1pVU9X6KiPHe75V7eEmQ_OJp_bRDS_bujlOnZPl6rpwhTIcghmDSgEyojJ9wM7f5MzCsXcBwQyLWj6GXhrD615NRN0D60 Aug 04 21:43:10.134637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:43:10.134637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:43:10.134637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:43:10.134637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:43:10.134637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:43:10.134637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:43:10.134637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: f738ce353ad649709334f71983434d3c Aug 04 21:43:10.134637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-VolumesNegativeTest-2129769395 Aug 04 21:43:10.134637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:43:10.134637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:43:10.136149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f738ce353ad649709334f71983434d3c", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f738ce353ad649709334f71983434d3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f738ce353ad649709334f71983434d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f738ce353ad649709334f71983434d3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:43:10.136149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-VolumesNegativeTest-2129769395 Aug 04 21:43:10.136149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: f738ce353ad649709334f71983434d3c Aug 04 21:43:10.136149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-VolumesNegativeTest-2129769395 Aug 04 21:43:10.136149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-VolumesNegativeTest-2129769395-project Aug 04 21:43:10.136149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:43:10.136149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:43:10.136149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: 7487daf672c04b1bb052a8a5e4875d61 Aug 04 21:43:10.136149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-VolumesNegativeTest-2129769395-project Aug 04 21:43:10.136149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 21:43:10.136149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Instance 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 could not be found. Aug 04 21:43:10.136149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': '5366ddc3-6224-49fe-a320-1fd0e9e1b4b3'} Aug 04 21:43:10.137402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:43:10.137402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:43:10.137402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:43:10.137402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:43:10.137402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:43:10.137402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:43:10.137402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:43:10.137402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:43:10.137402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:43:10.137402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:43:10.137402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 could not be found. Aug 04 21:43:10.137402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:43:10.137402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:43:10.137402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:43:10.137402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:43:10.137402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:43:10.137402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:43:10.137402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:43:10.137402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:43:10.137402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:43:10.138706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:43:10.138706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:43:10.138706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:43:10.138706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:43:10.138706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:43:10.138706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:43:10.138706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:43:10.138706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 could not be found. Aug 04 21:43:10.138706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:43:10.138706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:43:10.138706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:43:10.138706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:43:10.138706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:43:10.138706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:43:10.138706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:43:10.138706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:43:10.138706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 could not be found. Aug 04 21:43:10.138706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:43:10.139798 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-678ac8c4-c6a3-4b5c-9d92-d683ae941143 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] Returning 404 to user: Instance 5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:43:10.139798 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-678ac8c4-c6a3-4b5c-9d92-d683ae941143 tempest-VolumesNegativeTest-2129769395 tempest-VolumesNegativeTest-2129769395-project] 10.222.0.73 "GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3" status: 404 len: 111 microversion: 2.1 time: 0.035063 Aug 04 21:43:10.139798 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 240/484] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:10 2022] GET /compute/v2.1/servers/5366ddc3-6224-49fe-a320-1fd0e9e1b4b3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:43:10.414882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d8ab7c52-fd1a-43c2-a3a5-2b3b5e0b96c1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:10.416587 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d8ab7c52-fd1a-43c2-a3a5-2b3b5e0b96c1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:10.425028 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d8ab7c52-fd1a-43c2-a3a5-2b3b5e0b96c1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:10.425939 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d8ab7c52-fd1a-43c2-a3a5-2b3b5e0b96c1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:10.427204 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d8ab7c52-fd1a-43c2-a3a5-2b3b5e0b96c1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:10.428133 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d8ab7c52-fd1a-43c2-a3a5-2b3b5e0b96c1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:10.429258 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d8ab7c52-fd1a-43c2-a3a5-2b3b5e0b96c1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:10.429843 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d8ab7c52-fd1a-43c2-a3a5-2b3b5e0b96c1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:10.612265 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e0c1d160-40fb-4bcd-8e75-ce7dd645e9ba tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:10.612265 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e0c1d160-40fb-4bcd-8e75-ce7dd645e9ba tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:10.623125 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e0c1d160-40fb-4bcd-8e75-ce7dd645e9ba tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:10.623841 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e0c1d160-40fb-4bcd-8e75-ce7dd645e9ba tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:10.624048 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e0c1d160-40fb-4bcd-8e75-ce7dd645e9ba tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:10.631512 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e0c1d160-40fb-4bcd-8e75-ce7dd645e9ba tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:10.632050 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e0c1d160-40fb-4bcd-8e75-ce7dd645e9ba tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:10.632481 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e0c1d160-40fb-4bcd-8e75-ce7dd645e9ba tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:10.691969 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d8ab7c52-fd1a-43c2-a3a5-2b3b5e0b96c1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:10.700355 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d8ab7c52-fd1a-43c2-a3a5-2b3b5e0b96c1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1510 microversion: 2.1 time: 0.292969 Aug 04 21:43:10.700932 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 245/485] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:10 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1510 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:10.705219 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e0c1d160-40fb-4bcd-8e75-ce7dd645e9ba tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:10.705581 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-d60d3bbe-b88d-4bba-b3a9-c9924cf7cef5 req-da17f604-7230-48cd-b1f2-1b938fdfd992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae5df4a-c421-427c-abf7-7b22ba2bae5b", "name": "network-vif-deleted", "tag": "e77ac054-2f03-4ade-b8d9-ce7c960c09d8"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:43:10.715729 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-d60d3bbe-b88d-4bba-b3a9-c9924cf7cef5 req-da17f604-7230-48cd-b1f2-1b938fdfd992 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:10.716191 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-d60d3bbe-b88d-4bba-b3a9-c9924cf7cef5 req-da17f604-7230-48cd-b1f2-1b938fdfd992 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:10.716619 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-d60d3bbe-b88d-4bba-b3a9-c9924cf7cef5 req-da17f604-7230-48cd-b1f2-1b938fdfd992 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:10.716948 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e0c1d160-40fb-4bcd-8e75-ce7dd645e9ba tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1463 microversion: 2.1 time: 0.112941 Aug 04 21:43:10.719257 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 241/486] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:10 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1463 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:43:10.735934 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-d60d3bbe-b88d-4bba-b3a9-c9924cf7cef5 req-da17f604-7230-48cd-b1f2-1b938fdfd992 service nova] Creating event network-vif-deleted:e77ac054-2f03-4ade-b8d9-ce7c960c09d8 for instance 4ae5df4a-c421-427c-abf7-7b22ba2bae5b on hv-cinder-85220 Aug 04 21:43:10.742323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-d60d3bbe-b88d-4bba-b3a9-c9924cf7cef5 req-da17f604-7230-48cd-b1f2-1b938fdfd992 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039988 Aug 04 21:43:10.743058 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 246/487] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:43:11.723565 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-78145a1f-caa7-4f4d-8fb4-56121c1eb91f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:11.724814 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-78145a1f-caa7-4f4d-8fb4-56121c1eb91f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:11.731099 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-78145a1f-caa7-4f4d-8fb4-56121c1eb91f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:11.731589 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-78145a1f-caa7-4f4d-8fb4-56121c1eb91f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:11.732022 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-78145a1f-caa7-4f4d-8fb4-56121c1eb91f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:11.732717 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-78145a1f-caa7-4f4d-8fb4-56121c1eb91f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:11.733182 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-78145a1f-caa7-4f4d-8fb4-56121c1eb91f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:11.733592 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-78145a1f-caa7-4f4d-8fb4-56121c1eb91f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:11.743641 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-03590a2e-fb3f-481c-b424-feee873a0437 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:11.745315 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-03590a2e-fb3f-481c-b424-feee873a0437 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:11.751644 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03590a2e-fb3f-481c-b424-feee873a0437 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:11.752692 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03590a2e-fb3f-481c-b424-feee873a0437 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:11.753216 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03590a2e-fb3f-481c-b424-feee873a0437 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:11.754095 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03590a2e-fb3f-481c-b424-feee873a0437 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:11.755189 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03590a2e-fb3f-481c-b424-feee873a0437 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:11.755959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03590a2e-fb3f-481c-b424-feee873a0437 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:11.825138 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-03590a2e-fb3f-481c-b424-feee873a0437 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:11.836132 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-03590a2e-fb3f-481c-b424-feee873a0437 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1463 microversion: 2.1 time: 0.096596 Aug 04 21:43:11.837002 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 247/488] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:11 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1463 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:43:11.908881 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-78145a1f-caa7-4f4d-8fb4-56121c1eb91f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:11.916472 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-78145a1f-caa7-4f4d-8fb4-56121c1eb91f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1510 microversion: 2.1 time: 0.199100 Aug 04 21:43:11.917257 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 242/489] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:11 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1510 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:12.861486 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d4a72c6d-cf29-420f-b43b-aa0db186242e tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:12.862105 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d4a72c6d-cf29-420f-b43b-aa0db186242e tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:12.869970 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d4a72c6d-cf29-420f-b43b-aa0db186242e tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:12.870563 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d4a72c6d-cf29-420f-b43b-aa0db186242e tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:12.871177 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d4a72c6d-cf29-420f-b43b-aa0db186242e tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:12.871871 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d4a72c6d-cf29-420f-b43b-aa0db186242e tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:12.872312 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d4a72c6d-cf29-420f-b43b-aa0db186242e tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:12.873124 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d4a72c6d-cf29-420f-b43b-aa0db186242e tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:12.920386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d4a72c6d-cf29-420f-b43b-aa0db186242e tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:12.920873 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d4a72c6d-cf29-420f-b43b-aa0db186242e tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:12.921302 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d4a72c6d-cf29-420f-b43b-aa0db186242e tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:12.921941 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-d4a72c6d-cf29-420f-b43b-aa0db186242e tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lazy-loading 'fault' on Instance uuid 4ae5df4a-c421-427c-abf7-7b22ba2bae5b {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:43:12.938824 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-97daa095-622a-4e33-a277-3ad4acd73e3a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:12.939433 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-97daa095-622a-4e33-a277-3ad4acd73e3a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:12.941900 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:43:12.947380 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-97daa095-622a-4e33-a277-3ad4acd73e3a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:12.948037 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-97daa095-622a-4e33-a277-3ad4acd73e3a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:12.948475 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-97daa095-622a-4e33-a277-3ad4acd73e3a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:12.949168 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-97daa095-622a-4e33-a277-3ad4acd73e3a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:12.949617 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-97daa095-622a-4e33-a277-3ad4acd73e3a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:12.950079 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-97daa095-622a-4e33-a277-3ad4acd73e3a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:12.977579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d4a72c6d-cf29-420f-b43b-aa0db186242e tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4a45e9f40740c99cc49d9f2978332d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37a8c7b37ac4f8d9711ac8cd0e37f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:12.985435 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d4a72c6d-cf29-420f-b43b-aa0db186242e tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 200 len: 1304 microversion: 2.1 time: 0.127693 Aug 04 21:43:12.986340 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 248/490] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:12 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 1304 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:13.090566 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-97daa095-622a-4e33-a277-3ad4acd73e3a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:13.098355 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-97daa095-622a-4e33-a277-3ad4acd73e3a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1516 microversion: 2.1 time: 0.163740 Aug 04 21:43:13.099166 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 243/491] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:12 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:43:14.007220 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-175268e8-be33-4291-9800-8709b72b4100 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:14.007861 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-175268e8-be33-4291-9800-8709b72b4100 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] [instance: 4ae5df4a-c421-427c-abf7-7b22ba2bae5b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:14.014047 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-175268e8-be33-4291-9800-8709b72b4100 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:14.014518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-175268e8-be33-4291-9800-8709b72b4100 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:14.014950 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-175268e8-be33-4291-9800-8709b72b4100 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:14.015647 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-175268e8-be33-4291-9800-8709b72b4100 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:14.016089 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-175268e8-be33-4291-9800-8709b72b4100 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:14.016513 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-175268e8-be33-4291-9800-8709b72b4100 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:14.031213 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-175268e8-be33-4291-9800-8709b72b4100 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] HTTP exception thrown: Instance 4ae5df4a-c421-427c-abf7-7b22ba2bae5b could not be found. Aug 04 21:43:14.032903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-175268e8-be33-4291-9800-8709b72b4100 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Request method failure captured: Aug 04 21:43:14.032903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b HTTP/1.1 Aug 04 21:43:14.032903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:43:14.032903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:43:14.032903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:43:14.032903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:43:14.032903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:43:14.032903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:43:14.032903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:43:14.032903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:43:14.032903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7D0Udel8S0r7HhCNpVLJRu1OvxRapn-o3SLOcAmLAOL6hxCCZ9lODdKmshaEnN31E6PpiWwcne83PlJienyyS-RGt3w1oM-itfBenOOIP_luDAI_8FVUDnbtNQCwvJeGCHNON2mHySh6HdR36lNRTdVsPUSwIfriGjY1Vo4V7Y3MpmQ Aug 04 21:43:14.032903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:43:14.032903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:43:14.032903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:43:14.032903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:43:14.032903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:43:14.032903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:43:14.032903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: b37a8c7b37ac4f8d9711ac8cd0e37f02 Aug 04 21:43:14.032903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-VolumesActionsTest-1913954289 Aug 04 21:43:14.032903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:43:14.032903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:43:14.034509 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b37a8c7b37ac4f8d9711ac8cd0e37f02", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b37a8c7b37ac4f8d9711ac8cd0e37f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b37a8c7b37ac4f8d9711ac8cd0e37f02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b37a8c7b37ac4f8d9711ac8cd0e37f02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:43:14.034509 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-VolumesActionsTest-1913954289 Aug 04 21:43:14.034509 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: b37a8c7b37ac4f8d9711ac8cd0e37f02 Aug 04 21:43:14.034509 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-VolumesActionsTest-1913954289 Aug 04 21:43:14.034509 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-VolumesActionsTest-1913954289-project Aug 04 21:43:14.034509 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:43:14.034509 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:43:14.034509 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: db4a45e9f40740c99cc49d9f2978332d Aug 04 21:43:14.034509 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-VolumesActionsTest-1913954289-project Aug 04 21:43:14.034509 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:43:14.034509 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance 4ae5df4a-c421-427c-abf7-7b22ba2bae5b could not be found. Aug 04 21:43:14.034509 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': '4ae5df4a-c421-427c-abf7-7b22ba2bae5b'} Aug 04 21:43:14.035359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:43:14.035359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:43:14.035359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:43:14.035359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:43:14.035359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:43:14.035359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:43:14.035359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:43:14.035359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:43:14.035359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:43:14.035359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:43:14.035359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae5df4a-c421-427c-abf7-7b22ba2bae5b could not be found. Aug 04 21:43:14.035359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:43:14.035359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:43:14.035359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:43:14.035359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:43:14.035359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:43:14.035359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:43:14.035359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:43:14.035359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:43:14.035359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:43:14.037235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:43:14.037235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:43:14.037235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:43:14.037235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:43:14.037235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:43:14.037235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:43:14.037235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:43:14.037235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae5df4a-c421-427c-abf7-7b22ba2bae5b could not be found. Aug 04 21:43:14.037235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:43:14.037235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:43:14.037235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:43:14.037235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:43:14.037235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:43:14.037235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:43:14.037235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:43:14.037235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:43:14.037235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae5df4a-c421-427c-abf7-7b22ba2bae5b could not be found. Aug 04 21:43:14.037235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:43:14.045845 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-175268e8-be33-4291-9800-8709b72b4100 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] Returning 404 to user: Instance 4ae5df4a-c421-427c-abf7-7b22ba2bae5b could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:43:14.045845 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-175268e8-be33-4291-9800-8709b72b4100 tempest-VolumesActionsTest-1913954289 tempest-VolumesActionsTest-1913954289-project] 10.222.0.73 "GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b" status: 404 len: 111 microversion: 2.1 time: 0.031732 Aug 04 21:43:14.045845 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 249/492] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:14 2022] GET /compute/v2.1/servers/4ae5df4a-c421-427c-abf7-7b22ba2bae5b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:43:15.907710 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d51a30ab-5515-4315-8c39-631c3bf2ee31 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Action: 'create', calling method: .version_select at 0x7f3c107b4310>, body: {"keypair": {"name": "tempest-keypair-1368962378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRRIohkonbWuwGwkcA9IAFwa+vro4QaBYOX1RQsH+lYbtVKwEOlyyNJddurikIgCVQG0HeygwSGkeH72S9d5thDDVHrxbYOGIO1VWWk8+by8AwCq2aiCvrbiUb9oy9kLg=="}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:43:15.924797 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-d51a30ab-5515-4315-8c39-631c3bf2ee31 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Getting quotas for project 26fb895147494be98bb6ceb8704984b7. Resources: {'key_pairs'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:43:15.929485 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-d51a30ab-5515-4315-8c39-631c3bf2ee31 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Getting quotas for user d9bc42bec393430b9b3e9399a8c4f95e and project 26fb895147494be98bb6ceb8704984b7. Resources: {'key_pairs'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:43:16.058787 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d51a30ab-5515-4315-8c39-631c3bf2ee31 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.155653 Aug 04 21:43:16.064304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 244/493] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 4 21:43:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:43:18.219971 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b941a690-dbea-41a0-be5a-542b86534d34 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-991513024", "imageRef": "fca0c9ba-fb0a-4f30-932f-84d5253674ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b5f55cd-34ce-4149-9b84-6f8297ec2159"}], "security_groups": [{"name": "tempest-securitygroup--1709373395"}], "key_name": "tempest-keypair-1368962378", "user_data": "}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:43:18.320782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.network.neutron [None req-b941a690-dbea-41a0-be5a-542b86534d34 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] validate_networks() for [('2b5f55cd-34ce-4149-9b84-6f8297ec2159', None, None, None, None, None)] {{(pid=136342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:43:18.688280 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-b941a690-dbea-41a0-be5a-542b86534d34 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Flavor limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:43:18.688697 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-b941a690-dbea-41a0-be5a-542b86534d34 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Image limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:43:18.689177 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-b941a690-dbea-41a0-be5a-542b86534d34 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Flavor pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:43:18.689559 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-b941a690-dbea-41a0-be5a-542b86534d34 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Image pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:43:18.689963 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-b941a690-dbea-41a0-be5a-542b86534d34 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:43:18.699567 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b941a690-dbea-41a0-be5a-542b86534d34 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:18.700002 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b941a690-dbea-41a0-be5a-542b86534d34 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:18.700469 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b941a690-dbea-41a0-be5a-542b86534d34 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:18.701195 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b941a690-dbea-41a0-be5a-542b86534d34 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:18.701645 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b941a690-dbea-41a0-be5a-542b86534d34 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:18.702099 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b941a690-dbea-41a0-be5a-542b86534d34 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:18.719731 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-b941a690-dbea-41a0-be5a-542b86534d34 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Getting quotas for project 26fb895147494be98bb6ceb8704984b7. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:43:18.723852 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-b941a690-dbea-41a0-be5a-542b86534d34 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Getting quotas for user d9bc42bec393430b9b3e9399a8c4f95e and project 26fb895147494be98bb6ceb8704984b7. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:43:18.732846 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=100 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:43:18.735529 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b941a690-dbea-41a0-be5a-542b86534d34 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Going to run 1 instances... {{(pid=136342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:43:18.737777 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b941a690-dbea-41a0-be5a-542b86534d34 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca0c9ba-fb0a-4f30-932f-84d5253674ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:43:18.921212 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b941a690-dbea-41a0-be5a-542b86534d34 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.705502 Aug 04 21:43:18.921836 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 250/494] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 4 21:43:18 2022] POST /compute/v2.1/servers => generated 409 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:43:18.933270 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b41931b4-11bb-4af6-bb59-63ec9e6751ae tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:18.934554 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b41931b4-11bb-4af6-bb59-63ec9e6751ae tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:18.989903 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b41931b4-11bb-4af6-bb59-63ec9e6751ae tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:18.996871 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b41931b4-11bb-4af6-bb59-63ec9e6751ae tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1245 microversion: 2.1 time: 0.067632 Aug 04 21:43:18.997431 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 245/495] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:18 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1245 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:20.017618 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b1ffb847-4482-4434-91b5-5c6bd0d65a02 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:20.018251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b1ffb847-4482-4434-91b5-5c6bd0d65a02 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:20.025147 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b1ffb847-4482-4434-91b5-5c6bd0d65a02 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:20.025626 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b1ffb847-4482-4434-91b5-5c6bd0d65a02 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:20.026079 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b1ffb847-4482-4434-91b5-5c6bd0d65a02 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:20.026769 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b1ffb847-4482-4434-91b5-5c6bd0d65a02 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:20.027216 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b1ffb847-4482-4434-91b5-5c6bd0d65a02 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:20.039544 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b1ffb847-4482-4434-91b5-5c6bd0d65a02 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:20.089394 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b1ffb847-4482-4434-91b5-5c6bd0d65a02 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:20.096663 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b1ffb847-4482-4434-91b5-5c6bd0d65a02 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1249 microversion: 2.1 time: 0.082796 Aug 04 21:43:20.097216 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 251/496] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:20 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:21.117545 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-3e6ab9a0-ebb3-499b-a006-01ea22566bf1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:21.118203 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-3e6ab9a0-ebb3-499b-a006-01ea22566bf1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:21.125942 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3e6ab9a0-ebb3-499b-a006-01ea22566bf1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:21.126590 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3e6ab9a0-ebb3-499b-a006-01ea22566bf1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:21.127024 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3e6ab9a0-ebb3-499b-a006-01ea22566bf1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:21.127764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3e6ab9a0-ebb3-499b-a006-01ea22566bf1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:21.128238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3e6ab9a0-ebb3-499b-a006-01ea22566bf1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:21.128654 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3e6ab9a0-ebb3-499b-a006-01ea22566bf1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:21.195162 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-3e6ab9a0-ebb3-499b-a006-01ea22566bf1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:21.202867 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-3e6ab9a0-ebb3-499b-a006-01ea22566bf1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1297 microversion: 2.1 time: 0.090165 Aug 04 21:43:21.203425 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 246/497] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:21 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:22.233837 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-cb3e5bb7-55db-4df6-beaa-9acf7631783f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:22.236363 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-cb3e5bb7-55db-4df6-beaa-9acf7631783f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:22.250472 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cb3e5bb7-55db-4df6-beaa-9acf7631783f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:22.250472 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cb3e5bb7-55db-4df6-beaa-9acf7631783f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:22.251059 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cb3e5bb7-55db-4df6-beaa-9acf7631783f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:22.258932 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cb3e5bb7-55db-4df6-beaa-9acf7631783f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:22.259956 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cb3e5bb7-55db-4df6-beaa-9acf7631783f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:22.262534 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cb3e5bb7-55db-4df6-beaa-9acf7631783f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:22.543229 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-cb3e5bb7-55db-4df6-beaa-9acf7631783f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:22.553672 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-cb3e5bb7-55db-4df6-beaa-9acf7631783f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1371 microversion: 2.1 time: 0.331787 Aug 04 21:43:22.569259 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 252/498] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:22 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1371 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:23.576311 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ee3e408f-c4f7-4b74-9823-5a803f68de45 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:23.578618 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ee3e408f-c4f7-4b74-9823-5a803f68de45 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:23.595735 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ee3e408f-c4f7-4b74-9823-5a803f68de45 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:23.607416 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ee3e408f-c4f7-4b74-9823-5a803f68de45 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:23.607971 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ee3e408f-c4f7-4b74-9823-5a803f68de45 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:23.609715 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ee3e408f-c4f7-4b74-9823-5a803f68de45 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:23.610862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ee3e408f-c4f7-4b74-9823-5a803f68de45 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:23.614100 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ee3e408f-c4f7-4b74-9823-5a803f68de45 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:23.632758 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-5a27c334-2710-424d-a9c3-9fe31007f9e4 req-9d0c6d38-20dc-4675-a426-d0ed8b00a9e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c72a9092-7229-4677-9e8c-1849b5f3aaad", "tag": "0489e5c1-ed3b-4c8c-a0e2-848dabad5165"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:43:23.651580 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-5a27c334-2710-424d-a9c3-9fe31007f9e4 req-9d0c6d38-20dc-4675-a426-d0ed8b00a9e2 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:23.652077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-5a27c334-2710-424d-a9c3-9fe31007f9e4 req-9d0c6d38-20dc-4675-a426-d0ed8b00a9e2 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:23.652543 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-5a27c334-2710-424d-a9c3-9fe31007f9e4 req-9d0c6d38-20dc-4675-a426-d0ed8b00a9e2 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:23.672567 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-5a27c334-2710-424d-a9c3-9fe31007f9e4 req-9d0c6d38-20dc-4675-a426-d0ed8b00a9e2 service nova] Creating event network-changed:0489e5c1-ed3b-4c8c-a0e2-848dabad5165 for instance c72a9092-7229-4677-9e8c-1849b5f3aaad on hv-cinder-85220 Aug 04 21:43:23.679436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-5a27c334-2710-424d-a9c3-9fe31007f9e4 req-9d0c6d38-20dc-4675-a426-d0ed8b00a9e2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057557 Aug 04 21:43:23.680272 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 253/499] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:43:23.901669 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ee3e408f-c4f7-4b74-9823-5a803f68de45 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:23.915001 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ee3e408f-c4f7-4b74-9823-5a803f68de45 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1371 microversion: 2.1 time: 0.343655 Aug 04 21:43:23.915817 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 247/500] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:23 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1371 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:24.939733 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2115bc96-fd7e-465c-8c5a-ff7d856123fa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:24.940422 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2115bc96-fd7e-465c-8c5a-ff7d856123fa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:24.951648 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2115bc96-fd7e-465c-8c5a-ff7d856123fa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:24.952302 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2115bc96-fd7e-465c-8c5a-ff7d856123fa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:24.953159 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2115bc96-fd7e-465c-8c5a-ff7d856123fa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:24.953921 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2115bc96-fd7e-465c-8c5a-ff7d856123fa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:24.954383 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2115bc96-fd7e-465c-8c5a-ff7d856123fa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:24.954776 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2115bc96-fd7e-465c-8c5a-ff7d856123fa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:25.148855 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2115bc96-fd7e-465c-8c5a-ff7d856123fa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:25.157387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2115bc96-fd7e-465c-8c5a-ff7d856123fa tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1371 microversion: 2.1 time: 0.222277 Aug 04 21:43:25.158375 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 254/501] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:24 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:26.181508 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b8af4f4d-a110-4b92-9adf-613e623bf965 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:26.182301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b8af4f4d-a110-4b92-9adf-613e623bf965 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:26.189437 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b8af4f4d-a110-4b92-9adf-613e623bf965 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:26.189919 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b8af4f4d-a110-4b92-9adf-613e623bf965 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:26.191082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b8af4f4d-a110-4b92-9adf-613e623bf965 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:26.200099 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b8af4f4d-a110-4b92-9adf-613e623bf965 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:26.200682 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b8af4f4d-a110-4b92-9adf-613e623bf965 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:26.201121 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b8af4f4d-a110-4b92-9adf-613e623bf965 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:26.381416 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b8af4f4d-a110-4b92-9adf-613e623bf965 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:26.388490 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b8af4f4d-a110-4b92-9adf-613e623bf965 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1371 microversion: 2.1 time: 0.212441 Aug 04 21:43:26.389618 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 248/502] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:26 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:27.410758 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d6bbd0ee-b5cf-4868-ad6a-4f4a530b5ee0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:27.412536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d6bbd0ee-b5cf-4868-ad6a-4f4a530b5ee0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:27.423325 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d6bbd0ee-b5cf-4868-ad6a-4f4a530b5ee0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:27.424522 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d6bbd0ee-b5cf-4868-ad6a-4f4a530b5ee0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:27.425241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d6bbd0ee-b5cf-4868-ad6a-4f4a530b5ee0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:27.426292 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d6bbd0ee-b5cf-4868-ad6a-4f4a530b5ee0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:27.427973 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d6bbd0ee-b5cf-4868-ad6a-4f4a530b5ee0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:27.429068 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d6bbd0ee-b5cf-4868-ad6a-4f4a530b5ee0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:27.647544 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d6bbd0ee-b5cf-4868-ad6a-4f4a530b5ee0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:27.659708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d6bbd0ee-b5cf-4868-ad6a-4f4a530b5ee0 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1371 microversion: 2.1 time: 0.253789 Aug 04 21:43:27.672961 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 255/503] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:27 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1371 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:28.683197 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-81d943a7-4735-4b36-9dbe-56aed247d9e6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:28.683197 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-81d943a7-4735-4b36-9dbe-56aed247d9e6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:28.691742 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-81d943a7-4735-4b36-9dbe-56aed247d9e6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:28.694494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-81d943a7-4735-4b36-9dbe-56aed247d9e6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:28.698474 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-81d943a7-4735-4b36-9dbe-56aed247d9e6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:28.699592 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-81d943a7-4735-4b36-9dbe-56aed247d9e6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:28.701694 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-81d943a7-4735-4b36-9dbe-56aed247d9e6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:28.702345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-81d943a7-4735-4b36-9dbe-56aed247d9e6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:28.917753 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-81d943a7-4735-4b36-9dbe-56aed247d9e6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:28.926239 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-81d943a7-4735-4b36-9dbe-56aed247d9e6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1371 microversion: 2.1 time: 0.249348 Aug 04 21:43:28.941778 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 249/504] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:28 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1371 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:29.948231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-60e85e64-ba2b-4846-b020-cdf2dcc989e8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:29.948843 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-60e85e64-ba2b-4846-b020-cdf2dcc989e8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:29.950782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=2 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:43:29.951486 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=6 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:43:29.956127 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-60e85e64-ba2b-4846-b020-cdf2dcc989e8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:29.956600 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-60e85e64-ba2b-4846-b020-cdf2dcc989e8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:29.957020 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-60e85e64-ba2b-4846-b020-cdf2dcc989e8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:29.957698 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-60e85e64-ba2b-4846-b020-cdf2dcc989e8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:29.958168 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-60e85e64-ba2b-4846-b020-cdf2dcc989e8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:29.959069 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-60e85e64-ba2b-4846-b020-cdf2dcc989e8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:29.978039 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=100 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:43:30.187987 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-60e85e64-ba2b-4846-b020-cdf2dcc989e8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:30.200604 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-60e85e64-ba2b-4846-b020-cdf2dcc989e8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1371 microversion: 2.1 time: 0.255837 Aug 04 21:43:30.202434 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 256/505] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:29 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:31.090830 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-f03f07fc-d70b-4084-8ef2-4d8ebf58d8c1 req-f6d419f0-9527-4fbc-b5cb-36c82e7987a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c72a9092-7229-4677-9e8c-1849b5f3aaad", "name": "network-vif-plugged", "status": "completed", "tag": "0489e5c1-ed3b-4c8c-a0e2-848dabad5165"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:43:31.101282 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=6 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:43:31.106705 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-f03f07fc-d70b-4084-8ef2-4d8ebf58d8c1 req-f6d419f0-9527-4fbc-b5cb-36c82e7987a9 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:31.107433 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-f03f07fc-d70b-4084-8ef2-4d8ebf58d8c1 req-f6d419f0-9527-4fbc-b5cb-36c82e7987a9 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:31.108097 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-f03f07fc-d70b-4084-8ef2-4d8ebf58d8c1 req-f6d419f0-9527-4fbc-b5cb-36c82e7987a9 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:31.131403 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-f03f07fc-d70b-4084-8ef2-4d8ebf58d8c1 req-f6d419f0-9527-4fbc-b5cb-36c82e7987a9 service nova] Creating event network-vif-plugged:0489e5c1-ed3b-4c8c-a0e2-848dabad5165 for instance c72a9092-7229-4677-9e8c-1849b5f3aaad on hv-cinder-85220 Aug 04 21:43:31.136993 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-f03f07fc-d70b-4084-8ef2-4d8ebf58d8c1 req-f6d419f0-9527-4fbc-b5cb-36c82e7987a9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052152 Aug 04 21:43:31.138220 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 250/506] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:43:31.229524 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-0b02ef41-5335-452f-b033-756c30a16023 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:31.230881 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-0b02ef41-5335-452f-b033-756c30a16023 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:31.238600 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0b02ef41-5335-452f-b033-756c30a16023 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:31.240286 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0b02ef41-5335-452f-b033-756c30a16023 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:31.240933 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0b02ef41-5335-452f-b033-756c30a16023 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:31.242115 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0b02ef41-5335-452f-b033-756c30a16023 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:31.242733 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0b02ef41-5335-452f-b033-756c30a16023 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:31.243411 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0b02ef41-5335-452f-b033-756c30a16023 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:31.439702 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0b02ef41-5335-452f-b033-756c30a16023 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:31.451333 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-0b02ef41-5335-452f-b033-756c30a16023 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1371 microversion: 2.1 time: 0.228484 Aug 04 21:43:31.454343 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 257/507] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:31 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:43:32.474371 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-42469bc7-f803-4051-afa8-e01fa7586ecf tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:32.475811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-42469bc7-f803-4051-afa8-e01fa7586ecf tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:32.482375 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-42469bc7-f803-4051-afa8-e01fa7586ecf tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:32.487420 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-42469bc7-f803-4051-afa8-e01fa7586ecf tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:32.487420 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-42469bc7-f803-4051-afa8-e01fa7586ecf tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:32.487420 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-42469bc7-f803-4051-afa8-e01fa7586ecf tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:32.487420 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-42469bc7-f803-4051-afa8-e01fa7586ecf tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:32.487773 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-42469bc7-f803-4051-afa8-e01fa7586ecf tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:32.630491 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-42469bc7-f803-4051-afa8-e01fa7586ecf tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:32.638399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-42469bc7-f803-4051-afa8-e01fa7586ecf tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1371 microversion: 2.1 time: 0.169579 Aug 04 21:43:32.640313 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 251/508] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:32 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:33.659055 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-c44b1791-ea21-4f64-88c6-e2d37cbc265d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:33.659645 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-c44b1791-ea21-4f64-88c6-e2d37cbc265d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:33.666043 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c44b1791-ea21-4f64-88c6-e2d37cbc265d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:33.666520 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c44b1791-ea21-4f64-88c6-e2d37cbc265d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:33.666945 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c44b1791-ea21-4f64-88c6-e2d37cbc265d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:33.667634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c44b1791-ea21-4f64-88c6-e2d37cbc265d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:33.668079 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c44b1791-ea21-4f64-88c6-e2d37cbc265d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:33.668493 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c44b1791-ea21-4f64-88c6-e2d37cbc265d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:33.817443 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-c44b1791-ea21-4f64-88c6-e2d37cbc265d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:33.825579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-c44b1791-ea21-4f64-88c6-e2d37cbc265d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1371 microversion: 2.1 time: 0.170423 Aug 04 21:43:33.826782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 258/509] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:33 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:34.849328 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-39ca5584-b280-47b3-8b24-8fa466a1ee5a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:34.849935 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-39ca5584-b280-47b3-8b24-8fa466a1ee5a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:34.856568 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-39ca5584-b280-47b3-8b24-8fa466a1ee5a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:34.857054 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-39ca5584-b280-47b3-8b24-8fa466a1ee5a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:34.857491 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-39ca5584-b280-47b3-8b24-8fa466a1ee5a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:34.858235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-39ca5584-b280-47b3-8b24-8fa466a1ee5a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:34.858686 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-39ca5584-b280-47b3-8b24-8fa466a1ee5a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:34.859115 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-39ca5584-b280-47b3-8b24-8fa466a1ee5a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:35.014923 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-39ca5584-b280-47b3-8b24-8fa466a1ee5a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:35.024563 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-39ca5584-b280-47b3-8b24-8fa466a1ee5a tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1371 microversion: 2.1 time: 0.179810 Aug 04 21:43:35.039718 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 252/510] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:34 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:36.047456 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-902cdf50-8f77-4c06-adc9-0264f47c5dc9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:36.048157 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-902cdf50-8f77-4c06-adc9-0264f47c5dc9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:36.055890 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-902cdf50-8f77-4c06-adc9-0264f47c5dc9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:36.056746 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-902cdf50-8f77-4c06-adc9-0264f47c5dc9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:36.057305 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-902cdf50-8f77-4c06-adc9-0264f47c5dc9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:36.059958 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-902cdf50-8f77-4c06-adc9-0264f47c5dc9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:36.059958 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-902cdf50-8f77-4c06-adc9-0264f47c5dc9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:36.059958 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-902cdf50-8f77-4c06-adc9-0264f47c5dc9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:36.462354 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-902cdf50-8f77-4c06-adc9-0264f47c5dc9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:36.470466 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-902cdf50-8f77-4c06-adc9-0264f47c5dc9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1371 microversion: 2.1 time: 0.427144 Aug 04 21:43:36.471479 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 259/511] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:36 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1371 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:37.494487 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-6bcd8391-fcd3-4755-9099-54383e7a6b09 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:37.495185 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-6bcd8391-fcd3-4755-9099-54383e7a6b09 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:37.501458 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6bcd8391-fcd3-4755-9099-54383e7a6b09 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:37.504413 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6bcd8391-fcd3-4755-9099-54383e7a6b09 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:37.504413 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6bcd8391-fcd3-4755-9099-54383e7a6b09 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:37.504413 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6bcd8391-fcd3-4755-9099-54383e7a6b09 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:37.504413 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6bcd8391-fcd3-4755-9099-54383e7a6b09 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:37.504968 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6bcd8391-fcd3-4755-9099-54383e7a6b09 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:37.638634 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6bcd8391-fcd3-4755-9099-54383e7a6b09 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:37.647411 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-6bcd8391-fcd3-4755-9099-54383e7a6b09 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1371 microversion: 2.1 time: 0.157163 Aug 04 21:43:37.648122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 253/512] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:37 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:38.669104 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6a9404bb-e8ad-40b0-94b3-cdeb865fa3a2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:38.669699 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-6a9404bb-e8ad-40b0-94b3-cdeb865fa3a2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:38.675669 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6a9404bb-e8ad-40b0-94b3-cdeb865fa3a2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:38.676148 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6a9404bb-e8ad-40b0-94b3-cdeb865fa3a2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:38.677179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6a9404bb-e8ad-40b0-94b3-cdeb865fa3a2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:38.677863 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6a9404bb-e8ad-40b0-94b3-cdeb865fa3a2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:38.678337 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6a9404bb-e8ad-40b0-94b3-cdeb865fa3a2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:38.678755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6a9404bb-e8ad-40b0-94b3-cdeb865fa3a2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:38.814154 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6a9404bb-e8ad-40b0-94b3-cdeb865fa3a2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:38.821655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-6a9404bb-e8ad-40b0-94b3-cdeb865fa3a2 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1371 microversion: 2.1 time: 0.156327 Aug 04 21:43:38.822241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 260/513] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:38 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:39.842521 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-4f46e589-d35f-4e27-bae0-08e0932084e5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:39.843125 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-4f46e589-d35f-4e27-bae0-08e0932084e5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:39.849564 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4f46e589-d35f-4e27-bae0-08e0932084e5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:39.850071 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4f46e589-d35f-4e27-bae0-08e0932084e5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:39.852117 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4f46e589-d35f-4e27-bae0-08e0932084e5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:39.852117 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4f46e589-d35f-4e27-bae0-08e0932084e5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:39.852117 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4f46e589-d35f-4e27-bae0-08e0932084e5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:39.852117 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4f46e589-d35f-4e27-bae0-08e0932084e5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:39.855959 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:43:39.985510 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4f46e589-d35f-4e27-bae0-08e0932084e5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:43:39.993097 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-4f46e589-d35f-4e27-bae0-08e0932084e5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1566 microversion: 2.1 time: 0.154565 Aug 04 21:43:39.993659 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 254/514] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:43:39 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:43:40.014258 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-91f0977c-05df-40ae-8e37-3037264e5ce1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:43:40.014774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-91f0977c-05df-40ae-8e37-3037264e5ce1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:43:40.021675 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-91f0977c-05df-40ae-8e37-3037264e5ce1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:40.024230 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-91f0977c-05df-40ae-8e37-3037264e5ce1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:40.024230 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-91f0977c-05df-40ae-8e37-3037264e5ce1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:40.024230 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-91f0977c-05df-40ae-8e37-3037264e5ce1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:40.024660 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-91f0977c-05df-40ae-8e37-3037264e5ce1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:40.025085 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-91f0977c-05df-40ae-8e37-3037264e5ce1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:40.105837 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-91f0977c-05df-40ae-8e37-3037264e5ce1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095486 Aug 04 21:43:40.106492 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 261/515] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 4 21:43:40 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:43:41.285166 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-0ea7aa8f-0805-4616-90d9-2a2656a6e8ec req-6e6b2c50-76a8-4b63-8da8-c2acd92597cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c72a9092-7229-4677-9e8c-1849b5f3aaad", "tag": "0489e5c1-ed3b-4c8c-a0e2-848dabad5165"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:43:41.295079 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-0ea7aa8f-0805-4616-90d9-2a2656a6e8ec req-6e6b2c50-76a8-4b63-8da8-c2acd92597cc service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:43:41.295554 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-0ea7aa8f-0805-4616-90d9-2a2656a6e8ec req-6e6b2c50-76a8-4b63-8da8-c2acd92597cc service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:43:41.295973 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-0ea7aa8f-0805-4616-90d9-2a2656a6e8ec req-6e6b2c50-76a8-4b63-8da8-c2acd92597cc service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:43:41.307380 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-0ea7aa8f-0805-4616-90d9-2a2656a6e8ec req-6e6b2c50-76a8-4b63-8da8-c2acd92597cc service nova] Creating event network-changed:0489e5c1-ed3b-4c8c-a0e2-848dabad5165 for instance c72a9092-7229-4677-9e8c-1849b5f3aaad on hv-cinder-85220 Aug 04 21:43:41.312667 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-0ea7aa8f-0805-4616-90d9-2a2656a6e8ec req-6e6b2c50-76a8-4b63-8da8-c2acd92597cc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031027 Aug 04 21:43:41.313264 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 255/516] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:44:07.633869 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:44:07.634692 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=30 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:44:07.639116 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a52a8ea0-9e75-4708-a6a1-c3711763b5a2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:07.639600 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-a52a8ea0-9e75-4708-a6a1-c3711763b5a2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:07.645291 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a52a8ea0-9e75-4708-a6a1-c3711763b5a2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:07.645762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a52a8ea0-9e75-4708-a6a1-c3711763b5a2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:07.646230 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a52a8ea0-9e75-4708-a6a1-c3711763b5a2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:07.646912 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a52a8ea0-9e75-4708-a6a1-c3711763b5a2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:07.647357 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a52a8ea0-9e75-4708-a6a1-c3711763b5a2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:07.647772 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a52a8ea0-9e75-4708-a6a1-c3711763b5a2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:07.671447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-a52a8ea0-9e75-4708-a6a1-c3711763b5a2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126/ips" status: 200 len: 144 microversion: 2.1 time: 0.038409 Aug 04 21:44:07.672013 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 262/517] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 4 21:44:07 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:44:11.804468 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:44:11.805234 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=7 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:44:11.809750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2fb1a2de-75cf-4546-a8fb-d834f16f2721 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:11.810384 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-2fb1a2de-75cf-4546-a8fb-d834f16f2721 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:11.816339 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2fb1a2de-75cf-4546-a8fb-d834f16f2721 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:11.818559 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2fb1a2de-75cf-4546-a8fb-d834f16f2721 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:11.818559 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2fb1a2de-75cf-4546-a8fb-d834f16f2721 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:11.818559 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2fb1a2de-75cf-4546-a8fb-d834f16f2721 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:11.818559 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2fb1a2de-75cf-4546-a8fb-d834f16f2721 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:11.818888 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2fb1a2de-75cf-4546-a8fb-d834f16f2721 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:11.843504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2fb1a2de-75cf-4546-a8fb-d834f16f2721 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090/ips" status: 200 len: 151 microversion: 2.20 time: 0.040810 Aug 04 21:44:11.847129 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 256/518] 10.222.0.73 () {60 vars in 1289 bytes} [Thu Aug 4 21:44:11 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:44:13.295416 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-64d4f1d7-50ba-42fe-b667-8ddf7ac12695 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75959f3f-e96f-4449-8f85-c929d6100585"}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:44:13.298214 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-64d4f1d7-50ba-42fe-b667-8ddf7ac12695 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:13.304789 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-64d4f1d7-50ba-42fe-b667-8ddf7ac12695 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:13.305309 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-64d4f1d7-50ba-42fe-b667-8ddf7ac12695 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:13.305738 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-64d4f1d7-50ba-42fe-b667-8ddf7ac12695 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:13.306463 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-64d4f1d7-50ba-42fe-b667-8ddf7ac12695 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:13.306905 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-64d4f1d7-50ba-42fe-b667-8ddf7ac12695 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:13.307323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-64d4f1d7-50ba-42fe-b667-8ddf7ac12695 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:14.219198 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-64d4f1d7-50ba-42fe-b667-8ddf7ac12695 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "POST /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.928245 Aug 04 21:44:14.219857 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 263/519] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 4 21:44:13 2022] POST /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126/os-volume_attachments => generated 194 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:44:15.836986 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-7b0bb8e4-d106-49db-9b53-86b2626b570f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:44:15.837557 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-7b0bb8e4-d106-49db-9b53-86b2626b570f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:15.845303 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7b0bb8e4-d106-49db-9b53-86b2626b570f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:15.845783 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7b0bb8e4-d106-49db-9b53-86b2626b570f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:15.846249 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7b0bb8e4-d106-49db-9b53-86b2626b570f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:15.846937 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7b0bb8e4-d106-49db-9b53-86b2626b570f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:15.847388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7b0bb8e4-d106-49db-9b53-86b2626b570f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:15.847812 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7b0bb8e4-d106-49db-9b53-86b2626b570f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:15.870595 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.objects.instance [None req-7b0bb8e4-d106-49db-9b53-86b2626b570f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lazy-loading 'flavor' on Instance uuid 87934a42-5a51-4ba4-81ed-d07b785bc090 {{(pid=136341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:44:16.307515 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-7b0bb8e4-d106-49db-9b53-86b2626b570f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "POST /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090/action" status: 202 len: 0 microversion: 2.20 time: 0.474651 Aug 04 21:44:16.308090 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 257/520] 10.222.0.73 () {62 vars in 1319 bytes} [Thu Aug 4 21:44:15 2022] POST /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:44:16.317596 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d23941eb-b187-4803-97f7-44b8db595860 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:16.318382 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d23941eb-b187-4803-97f7-44b8db595860 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:16.325175 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d23941eb-b187-4803-97f7-44b8db595860 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:16.325657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d23941eb-b187-4803-97f7-44b8db595860 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:16.326154 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d23941eb-b187-4803-97f7-44b8db595860 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:16.326850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d23941eb-b187-4803-97f7-44b8db595860 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:16.327292 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d23941eb-b187-4803-97f7-44b8db595860 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:16.327712 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d23941eb-b187-4803-97f7-44b8db595860 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:16.458794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d23941eb-b187-4803-97f7-44b8db595860 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:16.467330 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d23941eb-b187-4803-97f7-44b8db595860 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:16.468820 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d23941eb-b187-4803-97f7-44b8db595860 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:16.469960 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d23941eb-b187-4803-97f7-44b8db595860 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1722 microversion: 2.20 time: 0.157228 Aug 04 21:44:16.470690 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 264/521] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:16 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:17.494130 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-09b33b8f-ca1d-4978-90cc-966eaa5a032c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:17.494716 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-09b33b8f-ca1d-4978-90cc-966eaa5a032c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:17.502868 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-09b33b8f-ca1d-4978-90cc-966eaa5a032c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:17.503343 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-09b33b8f-ca1d-4978-90cc-966eaa5a032c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:17.503769 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-09b33b8f-ca1d-4978-90cc-966eaa5a032c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:17.504453 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-09b33b8f-ca1d-4978-90cc-966eaa5a032c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:17.504895 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-09b33b8f-ca1d-4978-90cc-966eaa5a032c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:17.505306 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-09b33b8f-ca1d-4978-90cc-966eaa5a032c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:17.637793 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-09b33b8f-ca1d-4978-90cc-966eaa5a032c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:17.645693 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-09b33b8f-ca1d-4978-90cc-966eaa5a032c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:17.647298 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-09b33b8f-ca1d-4978-90cc-966eaa5a032c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:17.648446 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-09b33b8f-ca1d-4978-90cc-966eaa5a032c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1722 microversion: 2.20 time: 0.159372 Aug 04 21:44:17.648997 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 258/522] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:17 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:18.671745 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-0ccc0785-90f1-49b5-a577-f735be15b7be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:18.672340 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-0ccc0785-90f1-49b5-a577-f735be15b7be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:18.678778 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0ccc0785-90f1-49b5-a577-f735be15b7be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:18.679250 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0ccc0785-90f1-49b5-a577-f735be15b7be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:18.679677 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0ccc0785-90f1-49b5-a577-f735be15b7be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:18.680351 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0ccc0785-90f1-49b5-a577-f735be15b7be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:18.680790 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0ccc0785-90f1-49b5-a577-f735be15b7be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:18.681207 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0ccc0785-90f1-49b5-a577-f735be15b7be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:18.807194 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0ccc0785-90f1-49b5-a577-f735be15b7be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:18.815212 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0ccc0785-90f1-49b5-a577-f735be15b7be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:18.816720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0ccc0785-90f1-49b5-a577-f735be15b7be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:18.817866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-0ccc0785-90f1-49b5-a577-f735be15b7be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1722 microversion: 2.20 time: 0.150210 Aug 04 21:44:18.818450 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 265/523] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:18 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:19.840948 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-57a22477-fbfa-4053-978b-911dc7ab3937 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:19.841461 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-57a22477-fbfa-4053-978b-911dc7ab3937 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:19.847763 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-57a22477-fbfa-4053-978b-911dc7ab3937 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:19.848234 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-57a22477-fbfa-4053-978b-911dc7ab3937 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:19.848674 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-57a22477-fbfa-4053-978b-911dc7ab3937 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:19.849416 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-57a22477-fbfa-4053-978b-911dc7ab3937 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:19.849792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-57a22477-fbfa-4053-978b-911dc7ab3937 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:19.850235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-57a22477-fbfa-4053-978b-911dc7ab3937 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:19.982363 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-57a22477-fbfa-4053-978b-911dc7ab3937 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:19.990247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-57a22477-fbfa-4053-978b-911dc7ab3937 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:19.991756 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-57a22477-fbfa-4053-978b-911dc7ab3937 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:19.992913 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-57a22477-fbfa-4053-978b-911dc7ab3937 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1722 microversion: 2.20 time: 0.156035 Aug 04 21:44:19.993476 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 259/524] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:19 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:21.016619 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-9aa95692-4bd0-4182-9a8f-c22742b1bf33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:21.020817 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-9aa95692-4bd0-4182-9a8f-c22742b1bf33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:21.023733 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9aa95692-4bd0-4182-9a8f-c22742b1bf33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:21.024211 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9aa95692-4bd0-4182-9a8f-c22742b1bf33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:21.024646 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9aa95692-4bd0-4182-9a8f-c22742b1bf33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:21.025378 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9aa95692-4bd0-4182-9a8f-c22742b1bf33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:21.025826 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9aa95692-4bd0-4182-9a8f-c22742b1bf33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:21.026275 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9aa95692-4bd0-4182-9a8f-c22742b1bf33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:21.173678 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-9aa95692-4bd0-4182-9a8f-c22742b1bf33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:21.181725 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-9aa95692-4bd0-4182-9a8f-c22742b1bf33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:21.183247 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-9aa95692-4bd0-4182-9a8f-c22742b1bf33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:21.184379 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-9aa95692-4bd0-4182-9a8f-c22742b1bf33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1722 microversion: 2.20 time: 0.172250 Aug 04 21:44:21.185083 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 266/525] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:21 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:22.207599 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-4363bfcb-4f4b-467a-a0e8-fe42baac3f84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:22.208245 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-4363bfcb-4f4b-467a-a0e8-fe42baac3f84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:22.214264 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4363bfcb-4f4b-467a-a0e8-fe42baac3f84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:22.214615 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4363bfcb-4f4b-467a-a0e8-fe42baac3f84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:22.215120 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4363bfcb-4f4b-467a-a0e8-fe42baac3f84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:22.215833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4363bfcb-4f4b-467a-a0e8-fe42baac3f84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:22.216866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4363bfcb-4f4b-467a-a0e8-fe42baac3f84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:22.217366 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4363bfcb-4f4b-467a-a0e8-fe42baac3f84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:22.367855 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4363bfcb-4f4b-467a-a0e8-fe42baac3f84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:22.376044 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4363bfcb-4f4b-467a-a0e8-fe42baac3f84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:22.377551 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4363bfcb-4f4b-467a-a0e8-fe42baac3f84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:22.378750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-4363bfcb-4f4b-467a-a0e8-fe42baac3f84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1722 microversion: 2.20 time: 0.175181 Aug 04 21:44:22.379278 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 260/526] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:22 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:23.402152 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b4587a9b-c358-480e-b877-46fa868a84d4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:23.402759 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b4587a9b-c358-480e-b877-46fa868a84d4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:23.410445 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b4587a9b-c358-480e-b877-46fa868a84d4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:23.410931 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b4587a9b-c358-480e-b877-46fa868a84d4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:23.411372 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b4587a9b-c358-480e-b877-46fa868a84d4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:23.412072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b4587a9b-c358-480e-b877-46fa868a84d4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:23.412527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b4587a9b-c358-480e-b877-46fa868a84d4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:23.412951 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b4587a9b-c358-480e-b877-46fa868a84d4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:23.544601 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b4587a9b-c358-480e-b877-46fa868a84d4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:23.552960 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b4587a9b-c358-480e-b877-46fa868a84d4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:23.554498 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b4587a9b-c358-480e-b877-46fa868a84d4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:23.555651 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b4587a9b-c358-480e-b877-46fa868a84d4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1722 microversion: 2.20 time: 0.157562 Aug 04 21:44:23.556407 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 267/527] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:23 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:24.579636 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-53e60e00-8176-45be-8c44-bb3b7cae32cf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:24.581636 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-53e60e00-8176-45be-8c44-bb3b7cae32cf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:24.586776 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-53e60e00-8176-45be-8c44-bb3b7cae32cf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:24.587251 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-53e60e00-8176-45be-8c44-bb3b7cae32cf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:24.587676 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-53e60e00-8176-45be-8c44-bb3b7cae32cf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:24.588357 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-53e60e00-8176-45be-8c44-bb3b7cae32cf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:24.588801 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-53e60e00-8176-45be-8c44-bb3b7cae32cf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:24.589216 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-53e60e00-8176-45be-8c44-bb3b7cae32cf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:24.735197 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-53e60e00-8176-45be-8c44-bb3b7cae32cf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:24.743341 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-53e60e00-8176-45be-8c44-bb3b7cae32cf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:24.745284 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-53e60e00-8176-45be-8c44-bb3b7cae32cf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:24.746420 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-53e60e00-8176-45be-8c44-bb3b7cae32cf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1722 microversion: 2.20 time: 0.171541 Aug 04 21:44:24.747134 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 261/528] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:24 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:25.769999 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-02d03cca-1d88-4b5c-8a31-83d1faf1df00 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:25.770842 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-02d03cca-1d88-4b5c-8a31-83d1faf1df00 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:25.777182 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-02d03cca-1d88-4b5c-8a31-83d1faf1df00 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:25.777663 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-02d03cca-1d88-4b5c-8a31-83d1faf1df00 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:25.778121 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-02d03cca-1d88-4b5c-8a31-83d1faf1df00 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:25.778801 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-02d03cca-1d88-4b5c-8a31-83d1faf1df00 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:25.779239 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-02d03cca-1d88-4b5c-8a31-83d1faf1df00 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:25.780132 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-02d03cca-1d88-4b5c-8a31-83d1faf1df00 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:25.915608 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-02d03cca-1d88-4b5c-8a31-83d1faf1df00 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:25.923624 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-02d03cca-1d88-4b5c-8a31-83d1faf1df00 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:25.925102 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-02d03cca-1d88-4b5c-8a31-83d1faf1df00 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:25.926272 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-02d03cca-1d88-4b5c-8a31-83d1faf1df00 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1722 microversion: 2.20 time: 0.160414 Aug 04 21:44:25.926828 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 268/529] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:25 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:26.949014 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-872de348-e4c5-4b4e-9ef3-12b8091887fa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:26.949641 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-872de348-e4c5-4b4e-9ef3-12b8091887fa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:26.956455 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-872de348-e4c5-4b4e-9ef3-12b8091887fa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:26.956943 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-872de348-e4c5-4b4e-9ef3-12b8091887fa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:26.957374 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-872de348-e4c5-4b4e-9ef3-12b8091887fa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:26.958087 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-872de348-e4c5-4b4e-9ef3-12b8091887fa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:26.958539 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-872de348-e4c5-4b4e-9ef3-12b8091887fa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:26.958958 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-872de348-e4c5-4b4e-9ef3-12b8091887fa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:27.119600 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-872de348-e4c5-4b4e-9ef3-12b8091887fa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:27.133823 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-872de348-e4c5-4b4e-9ef3-12b8091887fa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:27.136878 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-872de348-e4c5-4b4e-9ef3-12b8091887fa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:27.138573 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-872de348-e4c5-4b4e-9ef3-12b8091887fa tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1722 microversion: 2.20 time: 0.193240 Aug 04 21:44:27.150850 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 262/530] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:26 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:28.163097 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-aeca7c5c-bd24-48e0-84ef-f6ad95604b67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:28.164644 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-aeca7c5c-bd24-48e0-84ef-f6ad95604b67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:28.169634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aeca7c5c-bd24-48e0-84ef-f6ad95604b67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:28.170158 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aeca7c5c-bd24-48e0-84ef-f6ad95604b67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:28.170587 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aeca7c5c-bd24-48e0-84ef-f6ad95604b67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:28.171330 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aeca7c5c-bd24-48e0-84ef-f6ad95604b67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:28.171771 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aeca7c5c-bd24-48e0-84ef-f6ad95604b67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:28.172185 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-aeca7c5c-bd24-48e0-84ef-f6ad95604b67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:28.286704 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-3b408bc8-bda5-4213-b384-14d221d4a2d2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:44:28.292655 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3b408bc8-bda5-4213-b384-14d221d4a2d2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:28.293139 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3b408bc8-bda5-4213-b384-14d221d4a2d2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:28.293572 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3b408bc8-bda5-4213-b384-14d221d4a2d2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:28.320932 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-aeca7c5c-bd24-48e0-84ef-f6ad95604b67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:28.329916 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-aeca7c5c-bd24-48e0-84ef-f6ad95604b67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:28.331884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-aeca7c5c-bd24-48e0-84ef-f6ad95604b67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:28.333361 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-aeca7c5c-bd24-48e0-84ef-f6ad95604b67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1722 microversion: 2.20 time: 0.174273 Aug 04 21:44:28.335136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 269/531] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:28 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:28.361910 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-3b408bc8-bda5-4213-b384-14d221d4a2d2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Going to try to stop instance {{(pid=136341) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 21:44:28.569372 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-3b408bc8-bda5-4213-b384-14d221d4a2d2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "POST /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126/action" status: 202 len: 0 microversion: 2.1 time: 0.286846 Aug 04 21:44:28.569981 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 263/532] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 4 21:44:28 2022] POST /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 21:44:28.578664 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-017a88e7-2cc1-4967-be75-1ce41e7ea756 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:28.579359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-017a88e7-2cc1-4967-be75-1ce41e7ea756 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:28.585291 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-017a88e7-2cc1-4967-be75-1ce41e7ea756 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:28.585771 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-017a88e7-2cc1-4967-be75-1ce41e7ea756 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:28.586247 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-017a88e7-2cc1-4967-be75-1ce41e7ea756 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:28.586932 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-017a88e7-2cc1-4967-be75-1ce41e7ea756 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:28.587377 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-017a88e7-2cc1-4967-be75-1ce41e7ea756 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:28.587795 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-017a88e7-2cc1-4967-be75-1ce41e7ea756 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:28.725172 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-017a88e7-2cc1-4967-be75-1ce41e7ea756 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:28.733322 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-017a88e7-2cc1-4967-be75-1ce41e7ea756 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1721 microversion: 2.1 time: 0.159076 Aug 04 21:44:28.734421 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 270/533] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:44:28 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:44:29.365023 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d54708f6-ac56-4667-90e5-95fc68543df6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:29.365730 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-d54708f6-ac56-4667-90e5-95fc68543df6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:29.372578 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d54708f6-ac56-4667-90e5-95fc68543df6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:29.373077 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d54708f6-ac56-4667-90e5-95fc68543df6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:29.377832 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d54708f6-ac56-4667-90e5-95fc68543df6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:29.377832 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d54708f6-ac56-4667-90e5-95fc68543df6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:29.377832 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d54708f6-ac56-4667-90e5-95fc68543df6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:29.377832 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d54708f6-ac56-4667-90e5-95fc68543df6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:29.515364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d54708f6-ac56-4667-90e5-95fc68543df6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:29.523901 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d54708f6-ac56-4667-90e5-95fc68543df6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:29.525221 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d54708f6-ac56-4667-90e5-95fc68543df6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:29.526401 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d54708f6-ac56-4667-90e5-95fc68543df6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1722 microversion: 2.20 time: 0.166291 Aug 04 21:44:29.526945 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 264/534] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:29 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:29.755660 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e53ca448-a91c-4be8-b4f8-377e3f62b478 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:29.756243 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e53ca448-a91c-4be8-b4f8-377e3f62b478 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:29.763212 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e53ca448-a91c-4be8-b4f8-377e3f62b478 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:29.763700 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e53ca448-a91c-4be8-b4f8-377e3f62b478 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:29.770488 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e53ca448-a91c-4be8-b4f8-377e3f62b478 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:29.770488 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e53ca448-a91c-4be8-b4f8-377e3f62b478 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:29.770488 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e53ca448-a91c-4be8-b4f8-377e3f62b478 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:29.770488 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e53ca448-a91c-4be8-b4f8-377e3f62b478 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:29.898762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e53ca448-a91c-4be8-b4f8-377e3f62b478 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:29.909419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e53ca448-a91c-4be8-b4f8-377e3f62b478 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1721 microversion: 2.1 time: 0.157808 Aug 04 21:44:29.909987 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 271/535] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:44:29 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:44:30.549537 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ac0eea89-9502-4ccc-ae1c-9c5ef207393a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:30.550168 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ac0eea89-9502-4ccc-ae1c-9c5ef207393a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:30.556752 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ac0eea89-9502-4ccc-ae1c-9c5ef207393a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:30.557249 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ac0eea89-9502-4ccc-ae1c-9c5ef207393a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:30.557675 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ac0eea89-9502-4ccc-ae1c-9c5ef207393a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:30.558377 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ac0eea89-9502-4ccc-ae1c-9c5ef207393a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:30.558822 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ac0eea89-9502-4ccc-ae1c-9c5ef207393a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:30.559361 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ac0eea89-9502-4ccc-ae1c-9c5ef207393a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:30.729946 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ac0eea89-9502-4ccc-ae1c-9c5ef207393a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:30.738673 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ac0eea89-9502-4ccc-ae1c-9c5ef207393a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:30.740355 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ac0eea89-9502-4ccc-ae1c-9c5ef207393a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:30.741580 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ac0eea89-9502-4ccc-ae1c-9c5ef207393a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1722 microversion: 2.20 time: 0.196745 Aug 04 21:44:30.742119 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 265/536] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:30 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:30.938496 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-7d92912a-4fa1-4d34-bd76-604dccf55071 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:30.942619 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7d92912a-4fa1-4d34-bd76-604dccf55071 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:30.946224 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7d92912a-4fa1-4d34-bd76-604dccf55071 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:30.946891 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7d92912a-4fa1-4d34-bd76-604dccf55071 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:30.947496 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7d92912a-4fa1-4d34-bd76-604dccf55071 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:30.948209 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7d92912a-4fa1-4d34-bd76-604dccf55071 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:30.948773 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7d92912a-4fa1-4d34-bd76-604dccf55071 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:30.949124 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7d92912a-4fa1-4d34-bd76-604dccf55071 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:31.095503 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7d92912a-4fa1-4d34-bd76-604dccf55071 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:31.103412 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-7d92912a-4fa1-4d34-bd76-604dccf55071 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1721 microversion: 2.1 time: 0.169043 Aug 04 21:44:31.103972 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 272/537] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:44:30 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:44:31.767460 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e7d21fb2-3bb9-404f-887d-d1bf7cc99bd2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:31.768106 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e7d21fb2-3bb9-404f-887d-d1bf7cc99bd2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:31.774460 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e7d21fb2-3bb9-404f-887d-d1bf7cc99bd2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:31.775004 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e7d21fb2-3bb9-404f-887d-d1bf7cc99bd2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:31.775380 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e7d21fb2-3bb9-404f-887d-d1bf7cc99bd2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:31.776066 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e7d21fb2-3bb9-404f-887d-d1bf7cc99bd2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:31.776521 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e7d21fb2-3bb9-404f-887d-d1bf7cc99bd2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:31.776945 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e7d21fb2-3bb9-404f-887d-d1bf7cc99bd2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:31.913310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e7d21fb2-3bb9-404f-887d-d1bf7cc99bd2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:31.921216 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e7d21fb2-3bb9-404f-887d-d1bf7cc99bd2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:31.923317 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e7d21fb2-3bb9-404f-887d-d1bf7cc99bd2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:31.924511 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e7d21fb2-3bb9-404f-887d-d1bf7cc99bd2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1722 microversion: 2.20 time: 0.161281 Aug 04 21:44:31.925071 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 266/538] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:31 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:32.125264 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-7c01f0ce-4dc4-42a3-a48a-426b02bb1a2e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:32.125887 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7c01f0ce-4dc4-42a3-a48a-426b02bb1a2e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:32.132395 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c01f0ce-4dc4-42a3-a48a-426b02bb1a2e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:32.132876 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c01f0ce-4dc4-42a3-a48a-426b02bb1a2e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:32.133311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c01f0ce-4dc4-42a3-a48a-426b02bb1a2e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:32.133995 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c01f0ce-4dc4-42a3-a48a-426b02bb1a2e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:32.134482 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c01f0ce-4dc4-42a3-a48a-426b02bb1a2e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:32.134901 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c01f0ce-4dc4-42a3-a48a-426b02bb1a2e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:32.267690 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7c01f0ce-4dc4-42a3-a48a-426b02bb1a2e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:32.275782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-7c01f0ce-4dc4-42a3-a48a-426b02bb1a2e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1721 microversion: 2.1 time: 0.154492 Aug 04 21:44:32.276392 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 273/539] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:44:32 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:44:32.948213 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a5a429fd-ff03-4c56-a9bb-360cc32dfa48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:32.948820 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a5a429fd-ff03-4c56-a9bb-360cc32dfa48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:32.956805 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a5a429fd-ff03-4c56-a9bb-360cc32dfa48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:32.957288 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a5a429fd-ff03-4c56-a9bb-360cc32dfa48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:32.957714 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a5a429fd-ff03-4c56-a9bb-360cc32dfa48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:32.958432 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a5a429fd-ff03-4c56-a9bb-360cc32dfa48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:32.958873 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a5a429fd-ff03-4c56-a9bb-360cc32dfa48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:32.959288 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a5a429fd-ff03-4c56-a9bb-360cc32dfa48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:33.095247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a5a429fd-ff03-4c56-a9bb-360cc32dfa48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:33.104844 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a5a429fd-ff03-4c56-a9bb-360cc32dfa48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:33.106561 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a5a429fd-ff03-4c56-a9bb-360cc32dfa48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:33.107562 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a5a429fd-ff03-4c56-a9bb-360cc32dfa48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1722 microversion: 2.20 time: 0.163435 Aug 04 21:44:33.108118 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 267/540] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:32 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:33.297727 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-94eea8d3-b09a-4f21-8a1d-54b493144392 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:33.298345 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-94eea8d3-b09a-4f21-8a1d-54b493144392 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:33.305638 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-94eea8d3-b09a-4f21-8a1d-54b493144392 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:33.306157 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-94eea8d3-b09a-4f21-8a1d-54b493144392 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:33.306589 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-94eea8d3-b09a-4f21-8a1d-54b493144392 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:33.307281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-94eea8d3-b09a-4f21-8a1d-54b493144392 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:33.307730 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-94eea8d3-b09a-4f21-8a1d-54b493144392 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:33.308168 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-94eea8d3-b09a-4f21-8a1d-54b493144392 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:33.449070 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-94eea8d3-b09a-4f21-8a1d-54b493144392 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:33.459223 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-94eea8d3-b09a-4f21-8a1d-54b493144392 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1721 microversion: 2.1 time: 0.165334 Aug 04 21:44:33.459877 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 274/541] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:44:33 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:44:34.132780 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-3bd5b926-8fb5-464f-846b-54bcda3eb809 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:34.133455 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-3bd5b926-8fb5-464f-846b-54bcda3eb809 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:34.139712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3bd5b926-8fb5-464f-846b-54bcda3eb809 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:34.140182 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3bd5b926-8fb5-464f-846b-54bcda3eb809 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:34.140610 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3bd5b926-8fb5-464f-846b-54bcda3eb809 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:34.141309 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3bd5b926-8fb5-464f-846b-54bcda3eb809 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:34.141731 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3bd5b926-8fb5-464f-846b-54bcda3eb809 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:34.142203 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3bd5b926-8fb5-464f-846b-54bcda3eb809 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:34.273886 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-3bd5b926-8fb5-464f-846b-54bcda3eb809 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:34.281657 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-3bd5b926-8fb5-464f-846b-54bcda3eb809 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:34.283870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-3bd5b926-8fb5-464f-846b-54bcda3eb809 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:34.285232 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-3bd5b926-8fb5-464f-846b-54bcda3eb809 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1722 microversion: 2.20 time: 0.156374 Aug 04 21:44:34.285847 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 268/542] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:34 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:34.480999 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d2409c28-56f4-443c-a6ff-4d3a2ade0ceb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:34.481607 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d2409c28-56f4-443c-a6ff-4d3a2ade0ceb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:34.488266 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d2409c28-56f4-443c-a6ff-4d3a2ade0ceb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:34.488749 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d2409c28-56f4-443c-a6ff-4d3a2ade0ceb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:34.489177 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d2409c28-56f4-443c-a6ff-4d3a2ade0ceb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:34.489868 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d2409c28-56f4-443c-a6ff-4d3a2ade0ceb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:34.490351 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d2409c28-56f4-443c-a6ff-4d3a2ade0ceb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:34.490765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d2409c28-56f4-443c-a6ff-4d3a2ade0ceb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:34.629834 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d2409c28-56f4-443c-a6ff-4d3a2ade0ceb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:34.638396 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d2409c28-56f4-443c-a6ff-4d3a2ade0ceb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1721 microversion: 2.1 time: 0.161355 Aug 04 21:44:34.638965 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 275/543] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:44:34 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:44:35.309329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-842ef5c1-9015-4734-992d-bfcb87a5fc8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:35.309927 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-842ef5c1-9015-4734-992d-bfcb87a5fc8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:35.316407 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-842ef5c1-9015-4734-992d-bfcb87a5fc8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:35.316888 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-842ef5c1-9015-4734-992d-bfcb87a5fc8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:35.317319 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-842ef5c1-9015-4734-992d-bfcb87a5fc8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:35.318017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-842ef5c1-9015-4734-992d-bfcb87a5fc8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:35.318468 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-842ef5c1-9015-4734-992d-bfcb87a5fc8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:35.318885 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-842ef5c1-9015-4734-992d-bfcb87a5fc8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:35.455440 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-842ef5c1-9015-4734-992d-bfcb87a5fc8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:35.459185 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:44:35.464003 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-842ef5c1-9015-4734-992d-bfcb87a5fc8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:35.465529 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-842ef5c1-9015-4734-992d-bfcb87a5fc8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:35.466717 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-842ef5c1-9015-4734-992d-bfcb87a5fc8f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1722 microversion: 2.20 time: 0.161300 Aug 04 21:44:35.467273 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 269/544] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:35 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:35.660213 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4116b2e8-18d5-4f5c-9755-86017333355f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:35.660729 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4116b2e8-18d5-4f5c-9755-86017333355f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:35.667100 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4116b2e8-18d5-4f5c-9755-86017333355f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:35.667563 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4116b2e8-18d5-4f5c-9755-86017333355f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:35.667991 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4116b2e8-18d5-4f5c-9755-86017333355f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:35.668668 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4116b2e8-18d5-4f5c-9755-86017333355f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:35.669110 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4116b2e8-18d5-4f5c-9755-86017333355f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:35.669523 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4116b2e8-18d5-4f5c-9755-86017333355f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:35.804751 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4116b2e8-18d5-4f5c-9755-86017333355f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:35.812777 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4116b2e8-18d5-4f5c-9755-86017333355f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1721 microversion: 2.1 time: 0.157049 Aug 04 21:44:35.813340 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 276/545] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:44:35 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:44:36.490795 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-700b9e6f-fef7-4479-8e6b-9761e535f41b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:36.491406 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-700b9e6f-fef7-4479-8e6b-9761e535f41b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:36.498747 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-700b9e6f-fef7-4479-8e6b-9761e535f41b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:36.499230 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-700b9e6f-fef7-4479-8e6b-9761e535f41b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:36.499668 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-700b9e6f-fef7-4479-8e6b-9761e535f41b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:36.500374 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-700b9e6f-fef7-4479-8e6b-9761e535f41b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:36.500825 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-700b9e6f-fef7-4479-8e6b-9761e535f41b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:36.501267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-700b9e6f-fef7-4479-8e6b-9761e535f41b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:36.639530 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-700b9e6f-fef7-4479-8e6b-9761e535f41b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:36.648764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-700b9e6f-fef7-4479-8e6b-9761e535f41b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:36.651346 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-700b9e6f-fef7-4479-8e6b-9761e535f41b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:36.652922 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-700b9e6f-fef7-4479-8e6b-9761e535f41b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1722 microversion: 2.20 time: 0.166240 Aug 04 21:44:36.653489 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 270/546] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:36 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:36.836041 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-593df528-60cf-408c-986b-352c1746c337 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:36.836668 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-593df528-60cf-408c-986b-352c1746c337 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:36.843243 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-593df528-60cf-408c-986b-352c1746c337 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:36.848102 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-593df528-60cf-408c-986b-352c1746c337 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:36.848102 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-593df528-60cf-408c-986b-352c1746c337 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:36.848102 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-593df528-60cf-408c-986b-352c1746c337 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:36.848102 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-593df528-60cf-408c-986b-352c1746c337 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:36.848511 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-593df528-60cf-408c-986b-352c1746c337 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:36.866403 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:44:36.991875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-593df528-60cf-408c-986b-352c1746c337 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:37.000227 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-593df528-60cf-408c-986b-352c1746c337 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1721 microversion: 2.1 time: 0.169186 Aug 04 21:44:37.000854 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 277/547] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:44:36 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:44:37.677376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-bfc89d76-9c14-44ab-bd84-e0a32ba2b0ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:37.678134 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-bfc89d76-9c14-44ab-bd84-e0a32ba2b0ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:37.684429 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bfc89d76-9c14-44ab-bd84-e0a32ba2b0ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:37.684909 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bfc89d76-9c14-44ab-bd84-e0a32ba2b0ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:37.685332 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bfc89d76-9c14-44ab-bd84-e0a32ba2b0ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:37.686062 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bfc89d76-9c14-44ab-bd84-e0a32ba2b0ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:37.687149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bfc89d76-9c14-44ab-bd84-e0a32ba2b0ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:37.687149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bfc89d76-9c14-44ab-bd84-e0a32ba2b0ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:37.823651 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-bfc89d76-9c14-44ab-bd84-e0a32ba2b0ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:37.831464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-bfc89d76-9c14-44ab-bd84-e0a32ba2b0ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:37.832929 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-bfc89d76-9c14-44ab-bd84-e0a32ba2b0ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:37.834109 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-bfc89d76-9c14-44ab-bd84-e0a32ba2b0ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1743 microversion: 2.20 time: 0.161224 Aug 04 21:44:37.834648 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 271/548] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:37 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:38.021480 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d88237d9-92b1-4aaa-962b-a7a42716cb4d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:38.022150 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d88237d9-92b1-4aaa-962b-a7a42716cb4d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:38.028619 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d88237d9-92b1-4aaa-962b-a7a42716cb4d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:38.029123 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d88237d9-92b1-4aaa-962b-a7a42716cb4d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:38.029553 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d88237d9-92b1-4aaa-962b-a7a42716cb4d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:38.030262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d88237d9-92b1-4aaa-962b-a7a42716cb4d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:38.030708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d88237d9-92b1-4aaa-962b-a7a42716cb4d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:38.031124 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d88237d9-92b1-4aaa-962b-a7a42716cb4d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:38.168466 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d88237d9-92b1-4aaa-962b-a7a42716cb4d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:38.177373 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d88237d9-92b1-4aaa-962b-a7a42716cb4d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1721 microversion: 2.1 time: 0.160608 Aug 04 21:44:38.181205 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 278/549] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:44:38 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:44:38.864658 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-1169a455-a4bd-448f-86f7-c9aede7a938f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:38.865217 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-1169a455-a4bd-448f-86f7-c9aede7a938f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:38.871809 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1169a455-a4bd-448f-86f7-c9aede7a938f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:38.872305 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1169a455-a4bd-448f-86f7-c9aede7a938f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:38.872720 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1169a455-a4bd-448f-86f7-c9aede7a938f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:38.873410 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1169a455-a4bd-448f-86f7-c9aede7a938f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:38.873851 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1169a455-a4bd-448f-86f7-c9aede7a938f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:38.874296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1169a455-a4bd-448f-86f7-c9aede7a938f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:39.017796 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-1169a455-a4bd-448f-86f7-c9aede7a938f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:39.027344 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-1169a455-a4bd-448f-86f7-c9aede7a938f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:39.028870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-1169a455-a4bd-448f-86f7-c9aede7a938f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:39.030081 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-1169a455-a4bd-448f-86f7-c9aede7a938f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1743 microversion: 2.20 time: 0.169375 Aug 04 21:44:39.030631 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 272/550] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:38 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:44:39.199297 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-1ec304b0-9645-4bd6-ae60-10ebb8c856c4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:39.200074 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-1ec304b0-9645-4bd6-ae60-10ebb8c856c4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:39.206675 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1ec304b0-9645-4bd6-ae60-10ebb8c856c4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:39.207157 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1ec304b0-9645-4bd6-ae60-10ebb8c856c4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:39.207598 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1ec304b0-9645-4bd6-ae60-10ebb8c856c4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:39.208295 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1ec304b0-9645-4bd6-ae60-10ebb8c856c4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:39.208748 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1ec304b0-9645-4bd6-ae60-10ebb8c856c4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:39.209167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1ec304b0-9645-4bd6-ae60-10ebb8c856c4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:39.390583 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1ec304b0-9645-4bd6-ae60-10ebb8c856c4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:39.394868 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-1ec304b0-9645-4bd6-ae60-10ebb8c856c4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1721 microversion: 2.1 time: 0.198818 Aug 04 21:44:39.395251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 279/551] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:44:39 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:44:40.053092 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-0803785d-a2ad-49ef-9417-a5ea7fba92b1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:40.053703 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-0803785d-a2ad-49ef-9417-a5ea7fba92b1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:40.060879 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0803785d-a2ad-49ef-9417-a5ea7fba92b1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:40.061513 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0803785d-a2ad-49ef-9417-a5ea7fba92b1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:40.062065 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0803785d-a2ad-49ef-9417-a5ea7fba92b1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:40.062769 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0803785d-a2ad-49ef-9417-a5ea7fba92b1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:40.063225 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0803785d-a2ad-49ef-9417-a5ea7fba92b1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:40.063725 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0803785d-a2ad-49ef-9417-a5ea7fba92b1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:40.245963 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-0803785d-a2ad-49ef-9417-a5ea7fba92b1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:40.254635 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-0803785d-a2ad-49ef-9417-a5ea7fba92b1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:40.256060 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-0803785d-a2ad-49ef-9417-a5ea7fba92b1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:40.257211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-0803785d-a2ad-49ef-9417-a5ea7fba92b1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1743 microversion: 2.20 time: 0.208378 Aug 04 21:44:40.257767 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 273/552] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:40 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1743 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:40.418183 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-7c844a73-5775-4239-be56-4a288a8a6141 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:40.419380 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7c844a73-5775-4239-be56-4a288a8a6141 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:40.426943 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c844a73-5775-4239-be56-4a288a8a6141 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:40.427533 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c844a73-5775-4239-be56-4a288a8a6141 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:40.428067 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c844a73-5775-4239-be56-4a288a8a6141 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:40.428887 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c844a73-5775-4239-be56-4a288a8a6141 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:40.429803 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c844a73-5775-4239-be56-4a288a8a6141 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:40.430331 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c844a73-5775-4239-be56-4a288a8a6141 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:40.601867 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7c844a73-5775-4239-be56-4a288a8a6141 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:40.609939 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-7c844a73-5775-4239-be56-4a288a8a6141 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1721 microversion: 2.1 time: 0.196889 Aug 04 21:44:40.610514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 280/553] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:44:40 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:44:41.280709 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f599d51d-90cc-4ab1-bc46-35f387f70484 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:41.281306 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-f599d51d-90cc-4ab1-bc46-35f387f70484 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:41.288375 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f599d51d-90cc-4ab1-bc46-35f387f70484 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:41.289154 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f599d51d-90cc-4ab1-bc46-35f387f70484 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:41.290608 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f599d51d-90cc-4ab1-bc46-35f387f70484 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:41.291595 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f599d51d-90cc-4ab1-bc46-35f387f70484 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:41.294285 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f599d51d-90cc-4ab1-bc46-35f387f70484 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:41.295122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f599d51d-90cc-4ab1-bc46-35f387f70484 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:41.326091 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-e40aa46f-f411-408e-bd44-b8ba0b7837b9 req-971c02ca-4e1f-40d6-9763-efce06b14410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87934a42-5a51-4ba4-81ed-d07b785bc090", "name": "network-vif-plugged", "status": "completed", "tag": "970090cc-8601-489b-8105-e93f171c77d4"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:44:41.339051 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-e40aa46f-f411-408e-bd44-b8ba0b7837b9 req-971c02ca-4e1f-40d6-9763-efce06b14410 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:41.339540 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-e40aa46f-f411-408e-bd44-b8ba0b7837b9 req-971c02ca-4e1f-40d6-9763-efce06b14410 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:41.339958 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-e40aa46f-f411-408e-bd44-b8ba0b7837b9 req-971c02ca-4e1f-40d6-9763-efce06b14410 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:41.353796 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-e40aa46f-f411-408e-bd44-b8ba0b7837b9 req-971c02ca-4e1f-40d6-9763-efce06b14410 service nova] Creating event network-vif-plugged:970090cc-8601-489b-8105-e93f171c77d4 for instance 87934a42-5a51-4ba4-81ed-d07b785bc090 on hv-cinder-85220 Aug 04 21:44:41.358890 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-e40aa46f-f411-408e-bd44-b8ba0b7837b9 req-971c02ca-4e1f-40d6-9763-efce06b14410 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038447 Aug 04 21:44:41.359421 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 281/554] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:44:41.435862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f599d51d-90cc-4ab1-bc46-35f387f70484 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:41.446322 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f599d51d-90cc-4ab1-bc46-35f387f70484 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:41.446322 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f599d51d-90cc-4ab1-bc46-35f387f70484 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:41.446966 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f599d51d-90cc-4ab1-bc46-35f387f70484 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1743 microversion: 2.20 time: 0.170102 Aug 04 21:44:41.447530 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 274/555] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:41 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:44:41.633307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-58cb0063-b7f8-4ac6-ad95-2018d6bc6611 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:41.633917 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-58cb0063-b7f8-4ac6-ad95-2018d6bc6611 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:41.640083 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-58cb0063-b7f8-4ac6-ad95-2018d6bc6611 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:41.640563 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-58cb0063-b7f8-4ac6-ad95-2018d6bc6611 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:41.641026 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-58cb0063-b7f8-4ac6-ad95-2018d6bc6611 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:41.641718 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-58cb0063-b7f8-4ac6-ad95-2018d6bc6611 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:41.642206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-58cb0063-b7f8-4ac6-ad95-2018d6bc6611 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:41.642635 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-58cb0063-b7f8-4ac6-ad95-2018d6bc6611 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:41.776356 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-58cb0063-b7f8-4ac6-ad95-2018d6bc6611 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:41.782501 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-58cb0063-b7f8-4ac6-ad95-2018d6bc6611 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1721 microversion: 2.1 time: 0.154318 Aug 04 21:44:41.783066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 282/556] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:44:41 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:44:42.470168 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-4ef19b04-847a-41c1-8efe-71ad599cab64 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:42.470780 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-4ef19b04-847a-41c1-8efe-71ad599cab64 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:42.476935 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4ef19b04-847a-41c1-8efe-71ad599cab64 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:42.477421 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4ef19b04-847a-41c1-8efe-71ad599cab64 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:42.477854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4ef19b04-847a-41c1-8efe-71ad599cab64 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:42.478575 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4ef19b04-847a-41c1-8efe-71ad599cab64 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:42.479030 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4ef19b04-847a-41c1-8efe-71ad599cab64 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:42.479460 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4ef19b04-847a-41c1-8efe-71ad599cab64 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:42.633048 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4ef19b04-847a-41c1-8efe-71ad599cab64 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:42.640823 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4ef19b04-847a-41c1-8efe-71ad599cab64 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:42.642433 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4ef19b04-847a-41c1-8efe-71ad599cab64 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:42.644201 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-4ef19b04-847a-41c1-8efe-71ad599cab64 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1743 microversion: 2.20 time: 0.177297 Aug 04 21:44:42.644795 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 275/557] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:42 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1743 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:42.804687 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-433eddb1-947c-43d4-8bca-d90e49b5c193 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:42.805293 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-433eddb1-947c-43d4-8bca-d90e49b5c193 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:42.811567 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-433eddb1-947c-43d4-8bca-d90e49b5c193 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:42.812041 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-433eddb1-947c-43d4-8bca-d90e49b5c193 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:42.812469 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-433eddb1-947c-43d4-8bca-d90e49b5c193 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:42.813167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-433eddb1-947c-43d4-8bca-d90e49b5c193 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:42.813583 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-433eddb1-947c-43d4-8bca-d90e49b5c193 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:42.814081 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-433eddb1-947c-43d4-8bca-d90e49b5c193 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:42.952644 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-433eddb1-947c-43d4-8bca-d90e49b5c193 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:42.961441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-433eddb1-947c-43d4-8bca-d90e49b5c193 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1721 microversion: 2.1 time: 0.160553 Aug 04 21:44:42.963696 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 283/558] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:44:42 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:44:43.667009 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-44468b46-23a0-442d-bff6-bcf952295bfb tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:43.667609 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-44468b46-23a0-442d-bff6-bcf952295bfb tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:43.675100 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-44468b46-23a0-442d-bff6-bcf952295bfb tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:43.677111 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-44468b46-23a0-442d-bff6-bcf952295bfb tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:43.677561 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-44468b46-23a0-442d-bff6-bcf952295bfb tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:43.678310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-44468b46-23a0-442d-bff6-bcf952295bfb tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:43.678766 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-44468b46-23a0-442d-bff6-bcf952295bfb tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:43.679206 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-44468b46-23a0-442d-bff6-bcf952295bfb tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:43.818281 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-44468b46-23a0-442d-bff6-bcf952295bfb tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:43.826150 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-44468b46-23a0-442d-bff6-bcf952295bfb tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:43.827675 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-44468b46-23a0-442d-bff6-bcf952295bfb tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:43.828819 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-44468b46-23a0-442d-bff6-bcf952295bfb tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1743 microversion: 2.20 time: 0.165950 Aug 04 21:44:43.829364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 276/559] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:43 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:44:43.983342 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-52cdb34d-c3a9-4b55-935b-ec05312ae3b7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:43.983945 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-52cdb34d-c3a9-4b55-935b-ec05312ae3b7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:43.985925 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=45 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:44:43.991796 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-52cdb34d-c3a9-4b55-935b-ec05312ae3b7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:43.992276 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-52cdb34d-c3a9-4b55-935b-ec05312ae3b7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:43.992702 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-52cdb34d-c3a9-4b55-935b-ec05312ae3b7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:43.993388 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-52cdb34d-c3a9-4b55-935b-ec05312ae3b7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:43.993831 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-52cdb34d-c3a9-4b55-935b-ec05312ae3b7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:43.994273 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-52cdb34d-c3a9-4b55-935b-ec05312ae3b7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:44.125183 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-52cdb34d-c3a9-4b55-935b-ec05312ae3b7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:44.133131 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-52cdb34d-c3a9-4b55-935b-ec05312ae3b7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1721 microversion: 2.1 time: 0.153762 Aug 04 21:44:44.133691 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 284/560] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:44:43 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:44:44.851892 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ff0b18a6-7b6a-4ebc-ad0b-520ac5e8c16c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:44.852404 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ff0b18a6-7b6a-4ebc-ad0b-520ac5e8c16c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:44.858954 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ff0b18a6-7b6a-4ebc-ad0b-520ac5e8c16c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:44.859468 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ff0b18a6-7b6a-4ebc-ad0b-520ac5e8c16c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:44.859825 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ff0b18a6-7b6a-4ebc-ad0b-520ac5e8c16c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:44.860531 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ff0b18a6-7b6a-4ebc-ad0b-520ac5e8c16c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:44.860959 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ff0b18a6-7b6a-4ebc-ad0b-520ac5e8c16c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:44.861387 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ff0b18a6-7b6a-4ebc-ad0b-520ac5e8c16c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:44.990801 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ff0b18a6-7b6a-4ebc-ad0b-520ac5e8c16c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:44.998996 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ff0b18a6-7b6a-4ebc-ad0b-520ac5e8c16c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:45.000476 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ff0b18a6-7b6a-4ebc-ad0b-520ac5e8c16c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:45.001608 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ff0b18a6-7b6a-4ebc-ad0b-520ac5e8c16c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1743 microversion: 2.20 time: 0.153725 Aug 04 21:44:45.002184 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 277/561] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:44 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:45.153707 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2621d2ce-5fb5-495f-9f0f-b423c8b4d75f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:45.154263 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2621d2ce-5fb5-495f-9f0f-b423c8b4d75f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:45.160901 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2621d2ce-5fb5-495f-9f0f-b423c8b4d75f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:45.162041 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2621d2ce-5fb5-495f-9f0f-b423c8b4d75f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:45.162041 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2621d2ce-5fb5-495f-9f0f-b423c8b4d75f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:45.162500 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2621d2ce-5fb5-495f-9f0f-b423c8b4d75f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:45.162949 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2621d2ce-5fb5-495f-9f0f-b423c8b4d75f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:45.163368 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2621d2ce-5fb5-495f-9f0f-b423c8b4d75f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:45.292658 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2621d2ce-5fb5-495f-9f0f-b423c8b4d75f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:45.301582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2621d2ce-5fb5-495f-9f0f-b423c8b4d75f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1698 microversion: 2.1 time: 0.151814 Aug 04 21:44:45.302154 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 285/562] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:44:45 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1698 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:44:45.323623 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-429755d4-73c8-41c8-9ce7-f5ac81586ae6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:44:45.329556 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-429755d4-73c8-41c8-9ce7-f5ac81586ae6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:45.330059 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-429755d4-73c8-41c8-9ce7-f5ac81586ae6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:45.330495 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-429755d4-73c8-41c8-9ce7-f5ac81586ae6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:45.352396 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-429755d4-73c8-41c8-9ce7-f5ac81586ae6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Going to try to start instance {{(pid=136341) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 21:44:45.527758 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-429755d4-73c8-41c8-9ce7-f5ac81586ae6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "POST /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126/action" status: 202 len: 0 microversion: 2.1 time: 0.208063 Aug 04 21:44:45.528393 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 278/563] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 4 21:44:45 2022] POST /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:44:45.537587 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-3d9d12ea-be7f-4ae0-843b-457cd2923a00 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:45.540759 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-3d9d12ea-be7f-4ae0-843b-457cd2923a00 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:45.544385 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d9d12ea-be7f-4ae0-843b-457cd2923a00 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:45.544877 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d9d12ea-be7f-4ae0-843b-457cd2923a00 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:45.545310 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d9d12ea-be7f-4ae0-843b-457cd2923a00 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:45.546139 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d9d12ea-be7f-4ae0-843b-457cd2923a00 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:45.546597 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d9d12ea-be7f-4ae0-843b-457cd2923a00 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:45.547051 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d9d12ea-be7f-4ae0-843b-457cd2923a00 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:45.703483 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-3d9d12ea-be7f-4ae0-843b-457cd2923a00 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:45.712317 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-3d9d12ea-be7f-4ae0-843b-457cd2923a00 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1707 microversion: 2.1 time: 0.179561 Aug 04 21:44:45.717112 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 286/564] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:44:45 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1707 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:44:46.028274 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-7a50db58-2564-452a-9da6-5c226035202f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:46.030200 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-7a50db58-2564-452a-9da6-5c226035202f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:46.033013 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=47 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:44:46.040484 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7a50db58-2564-452a-9da6-5c226035202f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:46.041217 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7a50db58-2564-452a-9da6-5c226035202f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:46.041650 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7a50db58-2564-452a-9da6-5c226035202f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:46.042582 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7a50db58-2564-452a-9da6-5c226035202f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:46.043081 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7a50db58-2564-452a-9da6-5c226035202f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:46.043569 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7a50db58-2564-452a-9da6-5c226035202f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:46.211851 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-7a50db58-2564-452a-9da6-5c226035202f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:46.226103 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-7a50db58-2564-452a-9da6-5c226035202f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:46.228269 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-7a50db58-2564-452a-9da6-5c226035202f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:46.231931 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-7a50db58-2564-452a-9da6-5c226035202f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1738 microversion: 2.20 time: 0.208873 Aug 04 21:44:46.234067 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 279/565] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:46 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:44:46.737692 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-5c9352d5-1198-4e0b-950d-fb463ca98a10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:46.739122 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-5c9352d5-1198-4e0b-950d-fb463ca98a10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:46.748997 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5c9352d5-1198-4e0b-950d-fb463ca98a10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:46.749874 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5c9352d5-1198-4e0b-950d-fb463ca98a10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:46.750844 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5c9352d5-1198-4e0b-950d-fb463ca98a10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:46.755375 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5c9352d5-1198-4e0b-950d-fb463ca98a10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:46.755375 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5c9352d5-1198-4e0b-950d-fb463ca98a10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:46.756152 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5c9352d5-1198-4e0b-950d-fb463ca98a10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:46.945351 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-5c9352d5-1198-4e0b-950d-fb463ca98a10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:46.957489 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-5c9352d5-1198-4e0b-950d-fb463ca98a10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1707 microversion: 2.1 time: 0.224710 Aug 04 21:44:46.958631 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 287/566] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:44:46 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1707 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:44:47.270721 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-9534f549-9a01-4560-8fcb-db4f0932c242 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:47.271426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-9534f549-9a01-4560-8fcb-db4f0932c242 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:47.279352 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9534f549-9a01-4560-8fcb-db4f0932c242 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:47.280091 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9534f549-9a01-4560-8fcb-db4f0932c242 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:47.280797 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9534f549-9a01-4560-8fcb-db4f0932c242 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:47.281653 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9534f549-9a01-4560-8fcb-db4f0932c242 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:47.282308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9534f549-9a01-4560-8fcb-db4f0932c242 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:47.283646 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9534f549-9a01-4560-8fcb-db4f0932c242 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:47.430661 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-9534f549-9a01-4560-8fcb-db4f0932c242 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:47.439557 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-9534f549-9a01-4560-8fcb-db4f0932c242 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:47.442435 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-9534f549-9a01-4560-8fcb-db4f0932c242 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:47.443893 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-9534f549-9a01-4560-8fcb-db4f0932c242 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1738 microversion: 2.20 time: 0.180187 Aug 04 21:44:47.444452 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 280/567] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:47 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:47.979895 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2a78dd4d-3dc4-4710-882a-bfb56a9dc28d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:47.980612 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2a78dd4d-3dc4-4710-882a-bfb56a9dc28d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:47.987145 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2a78dd4d-3dc4-4710-882a-bfb56a9dc28d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:47.987741 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2a78dd4d-3dc4-4710-882a-bfb56a9dc28d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:47.988079 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2a78dd4d-3dc4-4710-882a-bfb56a9dc28d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:47.988765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2a78dd4d-3dc4-4710-882a-bfb56a9dc28d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:47.989389 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2a78dd4d-3dc4-4710-882a-bfb56a9dc28d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:47.989815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2a78dd4d-3dc4-4710-882a-bfb56a9dc28d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:48.151677 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2a78dd4d-3dc4-4710-882a-bfb56a9dc28d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:48.161375 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2a78dd4d-3dc4-4710-882a-bfb56a9dc28d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1711 microversion: 2.1 time: 0.185246 Aug 04 21:44:48.162291 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 288/568] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:44:47 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1711 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:44:48.468054 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-3933eb08-1c8d-4107-b66f-407ea61e6c9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:48.469311 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-3933eb08-1c8d-4107-b66f-407ea61e6c9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:48.476782 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3933eb08-1c8d-4107-b66f-407ea61e6c9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:48.477503 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3933eb08-1c8d-4107-b66f-407ea61e6c9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:48.477935 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3933eb08-1c8d-4107-b66f-407ea61e6c9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:48.478817 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3933eb08-1c8d-4107-b66f-407ea61e6c9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:48.479538 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3933eb08-1c8d-4107-b66f-407ea61e6c9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:48.479957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3933eb08-1c8d-4107-b66f-407ea61e6c9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:48.632663 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-3933eb08-1c8d-4107-b66f-407ea61e6c9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:48.640493 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-3933eb08-1c8d-4107-b66f-407ea61e6c9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:48.641996 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-3933eb08-1c8d-4107-b66f-407ea61e6c9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:48.643349 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-3933eb08-1c8d-4107-b66f-407ea61e6c9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1738 microversion: 2.20 time: 0.179072 Aug 04 21:44:48.644473 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 281/569] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:48 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:49.666288 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-9ecd83d8-f87f-45a9-8ef6-d7f5e3658a58 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:49.667468 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-9ecd83d8-f87f-45a9-8ef6-d7f5e3658a58 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:49.674862 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9ecd83d8-f87f-45a9-8ef6-d7f5e3658a58 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:49.676393 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9ecd83d8-f87f-45a9-8ef6-d7f5e3658a58 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:49.677708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9ecd83d8-f87f-45a9-8ef6-d7f5e3658a58 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:49.678795 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9ecd83d8-f87f-45a9-8ef6-d7f5e3658a58 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:49.679257 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9ecd83d8-f87f-45a9-8ef6-d7f5e3658a58 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:49.679667 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9ecd83d8-f87f-45a9-8ef6-d7f5e3658a58 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:49.896302 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-9ecd83d8-f87f-45a9-8ef6-d7f5e3658a58 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:49.906260 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-9ecd83d8-f87f-45a9-8ef6-d7f5e3658a58 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:49.907907 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-9ecd83d8-f87f-45a9-8ef6-d7f5e3658a58 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:49.909121 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-9ecd83d8-f87f-45a9-8ef6-d7f5e3658a58 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1738 microversion: 2.20 time: 0.246717 Aug 04 21:44:49.909667 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 289/570] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:49 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:50.932355 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-336522d5-0f50-46fa-9f40-585b86512aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:50.933119 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-336522d5-0f50-46fa-9f40-585b86512aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:50.939350 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-336522d5-0f50-46fa-9f40-585b86512aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:50.939824 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-336522d5-0f50-46fa-9f40-585b86512aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:50.940507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-336522d5-0f50-46fa-9f40-585b86512aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:50.941191 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-336522d5-0f50-46fa-9f40-585b86512aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:50.941927 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-336522d5-0f50-46fa-9f40-585b86512aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:50.942153 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-336522d5-0f50-46fa-9f40-585b86512aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:51.091158 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-336522d5-0f50-46fa-9f40-585b86512aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:51.102270 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-336522d5-0f50-46fa-9f40-585b86512aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:51.103406 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-336522d5-0f50-46fa-9f40-585b86512aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:51.104972 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-336522d5-0f50-46fa-9f40-585b86512aab tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1738 microversion: 2.20 time: 0.176182 Aug 04 21:44:51.105535 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 282/571] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:50 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:52.130056 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-5bb1c1ec-10b6-4ac1-b749-173ab6721441 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:52.131403 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-5bb1c1ec-10b6-4ac1-b749-173ab6721441 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:52.139894 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5bb1c1ec-10b6-4ac1-b749-173ab6721441 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:52.140381 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5bb1c1ec-10b6-4ac1-b749-173ab6721441 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:52.140816 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5bb1c1ec-10b6-4ac1-b749-173ab6721441 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:52.141513 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5bb1c1ec-10b6-4ac1-b749-173ab6721441 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:52.141986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5bb1c1ec-10b6-4ac1-b749-173ab6721441 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:52.142415 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5bb1c1ec-10b6-4ac1-b749-173ab6721441 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:52.284581 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-5bb1c1ec-10b6-4ac1-b749-173ab6721441 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:52.295039 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-5bb1c1ec-10b6-4ac1-b749-173ab6721441 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:52.300323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-5bb1c1ec-10b6-4ac1-b749-173ab6721441 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:52.300323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-5bb1c1ec-10b6-4ac1-b749-173ab6721441 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1738 microversion: 2.20 time: 0.173169 Aug 04 21:44:52.300323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 290/572] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:52 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:53.323435 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-5e728565-ec0d-42fa-9f00-295f2a20152e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:53.324364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-5e728565-ec0d-42fa-9f00-295f2a20152e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:53.332065 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5e728565-ec0d-42fa-9f00-295f2a20152e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:53.332526 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5e728565-ec0d-42fa-9f00-295f2a20152e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:53.333073 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5e728565-ec0d-42fa-9f00-295f2a20152e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:53.333993 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5e728565-ec0d-42fa-9f00-295f2a20152e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:53.334535 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5e728565-ec0d-42fa-9f00-295f2a20152e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:53.335025 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5e728565-ec0d-42fa-9f00-295f2a20152e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:53.505032 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5e728565-ec0d-42fa-9f00-295f2a20152e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:53.516791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5e728565-ec0d-42fa-9f00-295f2a20152e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:53.519767 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5e728565-ec0d-42fa-9f00-295f2a20152e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:53.525373 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-5e728565-ec0d-42fa-9f00-295f2a20152e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1738 microversion: 2.20 time: 0.202073 Aug 04 21:44:53.525373 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 283/573] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:53 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:54.544952 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d2df1dd7-0540-4b2e-b44a-9a13a7ec5443 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:54.546534 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d2df1dd7-0540-4b2e-b44a-9a13a7ec5443 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:54.555784 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d2df1dd7-0540-4b2e-b44a-9a13a7ec5443 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:54.556710 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d2df1dd7-0540-4b2e-b44a-9a13a7ec5443 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:54.557323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d2df1dd7-0540-4b2e-b44a-9a13a7ec5443 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:54.558276 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d2df1dd7-0540-4b2e-b44a-9a13a7ec5443 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:54.558947 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d2df1dd7-0540-4b2e-b44a-9a13a7ec5443 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:54.559609 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d2df1dd7-0540-4b2e-b44a-9a13a7ec5443 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:54.741401 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d2df1dd7-0540-4b2e-b44a-9a13a7ec5443 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:54.755262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d2df1dd7-0540-4b2e-b44a-9a13a7ec5443 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:54.756981 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d2df1dd7-0540-4b2e-b44a-9a13a7ec5443 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:54.759650 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d2df1dd7-0540-4b2e-b44a-9a13a7ec5443 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1738 microversion: 2.20 time: 0.218100 Aug 04 21:44:54.760488 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 291/574] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:54 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:55.786501 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b0f312d6-b3bd-4b93-9d4c-7528b6a31f48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:55.787112 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b0f312d6-b3bd-4b93-9d4c-7528b6a31f48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:55.793474 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b0f312d6-b3bd-4b93-9d4c-7528b6a31f48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:55.793948 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b0f312d6-b3bd-4b93-9d4c-7528b6a31f48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:55.794403 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b0f312d6-b3bd-4b93-9d4c-7528b6a31f48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:55.795078 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b0f312d6-b3bd-4b93-9d4c-7528b6a31f48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:55.795514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b0f312d6-b3bd-4b93-9d4c-7528b6a31f48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:55.795927 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b0f312d6-b3bd-4b93-9d4c-7528b6a31f48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:55.929674 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b0f312d6-b3bd-4b93-9d4c-7528b6a31f48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:55.937774 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b0f312d6-b3bd-4b93-9d4c-7528b6a31f48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:55.939359 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b0f312d6-b3bd-4b93-9d4c-7528b6a31f48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:55.940780 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b0f312d6-b3bd-4b93-9d4c-7528b6a31f48 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1738 microversion: 2.20 time: 0.158133 Aug 04 21:44:55.941445 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 284/575] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:55 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:56.975576 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-bb3d8e45-50a1-49d2-9875-eaf95a81e5dd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:56.976460 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-bb3d8e45-50a1-49d2-9875-eaf95a81e5dd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:57.003630 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bb3d8e45-50a1-49d2-9875-eaf95a81e5dd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:57.005003 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bb3d8e45-50a1-49d2-9875-eaf95a81e5dd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:57.008223 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bb3d8e45-50a1-49d2-9875-eaf95a81e5dd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:57.010707 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bb3d8e45-50a1-49d2-9875-eaf95a81e5dd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:57.013187 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bb3d8e45-50a1-49d2-9875-eaf95a81e5dd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:57.013998 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bb3d8e45-50a1-49d2-9875-eaf95a81e5dd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:57.259515 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-bb3d8e45-50a1-49d2-9875-eaf95a81e5dd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:57.268379 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-bb3d8e45-50a1-49d2-9875-eaf95a81e5dd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:57.272049 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-bb3d8e45-50a1-49d2-9875-eaf95a81e5dd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:57.272049 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-bb3d8e45-50a1-49d2-9875-eaf95a81e5dd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1738 microversion: 2.20 time: 0.308106 Aug 04 21:44:57.297887 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 292/576] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:56 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1738 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:58.297061 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-0bfcff6f-8c92-4e77-8ccb-d9f3306a4e27 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:58.297645 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-0bfcff6f-8c92-4e77-8ccb-d9f3306a4e27 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:58.305004 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0bfcff6f-8c92-4e77-8ccb-d9f3306a4e27 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:58.305501 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0bfcff6f-8c92-4e77-8ccb-d9f3306a4e27 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:58.306194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0bfcff6f-8c92-4e77-8ccb-d9f3306a4e27 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:58.307129 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0bfcff6f-8c92-4e77-8ccb-d9f3306a4e27 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:58.307646 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0bfcff6f-8c92-4e77-8ccb-d9f3306a4e27 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:58.308275 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0bfcff6f-8c92-4e77-8ccb-d9f3306a4e27 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:58.332162 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:44:58.471580 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-0bfcff6f-8c92-4e77-8ccb-d9f3306a4e27 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:58.483764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-0bfcff6f-8c92-4e77-8ccb-d9f3306a4e27 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:58.485575 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-0bfcff6f-8c92-4e77-8ccb-d9f3306a4e27 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:58.487317 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-0bfcff6f-8c92-4e77-8ccb-d9f3306a4e27 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1738 microversion: 2.20 time: 0.194173 Aug 04 21:44:58.489081 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 285/577] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:58 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:44:59.511395 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2329c32f-3f21-4b74-a811-9b3e7c8b3d34 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:44:59.512035 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2329c32f-3f21-4b74-a811-9b3e7c8b3d34 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:44:59.518594 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2329c32f-3f21-4b74-a811-9b3e7c8b3d34 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:59.519081 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2329c32f-3f21-4b74-a811-9b3e7c8b3d34 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:59.519514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2329c32f-3f21-4b74-a811-9b3e7c8b3d34 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:59.520437 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2329c32f-3f21-4b74-a811-9b3e7c8b3d34 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:44:59.520893 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2329c32f-3f21-4b74-a811-9b3e7c8b3d34 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:44:59.521343 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2329c32f-3f21-4b74-a811-9b3e7c8b3d34 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:44:59.656255 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2329c32f-3f21-4b74-a811-9b3e7c8b3d34 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:59.666393 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2329c32f-3f21-4b74-a811-9b3e7c8b3d34 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:59.666393 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2329c32f-3f21-4b74-a811-9b3e7c8b3d34 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:44:59.666955 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2329c32f-3f21-4b74-a811-9b3e7c8b3d34 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1738 microversion: 2.20 time: 0.159503 Aug 04 21:44:59.667549 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 293/578] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:44:59 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:00.690027 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-26c5a216-43ec-45fe-a324-a25279dec3d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:00.690949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-26c5a216-43ec-45fe-a324-a25279dec3d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:00.697722 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-26c5a216-43ec-45fe-a324-a25279dec3d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:00.698244 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-26c5a216-43ec-45fe-a324-a25279dec3d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:00.698682 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-26c5a216-43ec-45fe-a324-a25279dec3d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:00.699355 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-26c5a216-43ec-45fe-a324-a25279dec3d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:00.699796 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-26c5a216-43ec-45fe-a324-a25279dec3d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:00.700206 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-26c5a216-43ec-45fe-a324-a25279dec3d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:00.841888 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-26c5a216-43ec-45fe-a324-a25279dec3d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:00.850196 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-26c5a216-43ec-45fe-a324-a25279dec3d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:00.851699 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-26c5a216-43ec-45fe-a324-a25279dec3d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:00.853172 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-26c5a216-43ec-45fe-a324-a25279dec3d9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1738 microversion: 2.20 time: 0.167128 Aug 04 21:45:00.853809 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 286/579] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:00 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:01.877518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8c076dc0-accd-40d3-85cd-7d3c33871fa9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:01.878375 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8c076dc0-accd-40d3-85cd-7d3c33871fa9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:01.886204 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8c076dc0-accd-40d3-85cd-7d3c33871fa9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:01.886619 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8c076dc0-accd-40d3-85cd-7d3c33871fa9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:01.887041 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8c076dc0-accd-40d3-85cd-7d3c33871fa9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:01.887916 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8c076dc0-accd-40d3-85cd-7d3c33871fa9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:01.888528 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8c076dc0-accd-40d3-85cd-7d3c33871fa9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:01.889068 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8c076dc0-accd-40d3-85cd-7d3c33871fa9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:02.022388 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8c076dc0-accd-40d3-85cd-7d3c33871fa9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:02.025963 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=100 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:45:02.031067 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8c076dc0-accd-40d3-85cd-7d3c33871fa9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:02.033277 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8c076dc0-accd-40d3-85cd-7d3c33871fa9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:02.033795 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8c076dc0-accd-40d3-85cd-7d3c33871fa9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1738 microversion: 2.20 time: 0.160725 Aug 04 21:45:02.034389 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 294/580] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:01 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:03.057005 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-5f4dbb67-2c9d-445c-a273-f8103537918f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:03.057623 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-5f4dbb67-2c9d-445c-a273-f8103537918f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:03.064039 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5f4dbb67-2c9d-445c-a273-f8103537918f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:03.064514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5f4dbb67-2c9d-445c-a273-f8103537918f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:03.064940 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5f4dbb67-2c9d-445c-a273-f8103537918f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:03.065612 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5f4dbb67-2c9d-445c-a273-f8103537918f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:03.066071 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5f4dbb67-2c9d-445c-a273-f8103537918f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:03.066487 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5f4dbb67-2c9d-445c-a273-f8103537918f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:03.192310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5f4dbb67-2c9d-445c-a273-f8103537918f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:03.200302 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5f4dbb67-2c9d-445c-a273-f8103537918f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:03.201809 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5f4dbb67-2c9d-445c-a273-f8103537918f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:03.202997 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-5f4dbb67-2c9d-445c-a273-f8103537918f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1720 microversion: 2.20 time: 0.149972 Aug 04 21:45:03.203558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 287/581] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:03 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:04.226986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d8d0db16-adf4-40c1-9add-d25b33e2e068 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:04.227587 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d8d0db16-adf4-40c1-9add-d25b33e2e068 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:04.234609 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d8d0db16-adf4-40c1-9add-d25b33e2e068 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:04.235084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d8d0db16-adf4-40c1-9add-d25b33e2e068 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:04.235520 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d8d0db16-adf4-40c1-9add-d25b33e2e068 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:04.236199 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d8d0db16-adf4-40c1-9add-d25b33e2e068 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:04.236645 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d8d0db16-adf4-40c1-9add-d25b33e2e068 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:04.237065 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d8d0db16-adf4-40c1-9add-d25b33e2e068 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:04.366323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d8d0db16-adf4-40c1-9add-d25b33e2e068 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:04.374446 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d8d0db16-adf4-40c1-9add-d25b33e2e068 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:04.378765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d8d0db16-adf4-40c1-9add-d25b33e2e068 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:04.378765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d8d0db16-adf4-40c1-9add-d25b33e2e068 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1720 microversion: 2.20 time: 0.154891 Aug 04 21:45:04.378765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 295/582] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:04 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:05.400267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-16678b08-2855-4c2f-a264-da64fd34f90d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:05.400865 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-16678b08-2855-4c2f-a264-da64fd34f90d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:05.407246 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-16678b08-2855-4c2f-a264-da64fd34f90d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:05.407717 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-16678b08-2855-4c2f-a264-da64fd34f90d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:05.408143 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-16678b08-2855-4c2f-a264-da64fd34f90d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:05.408818 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-16678b08-2855-4c2f-a264-da64fd34f90d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:05.409261 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-16678b08-2855-4c2f-a264-da64fd34f90d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:05.409678 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-16678b08-2855-4c2f-a264-da64fd34f90d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:05.538180 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-16678b08-2855-4c2f-a264-da64fd34f90d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:05.547060 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-16678b08-2855-4c2f-a264-da64fd34f90d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:05.548603 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-16678b08-2855-4c2f-a264-da64fd34f90d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:05.549762 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-16678b08-2855-4c2f-a264-da64fd34f90d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1720 microversion: 2.20 time: 0.153545 Aug 04 21:45:05.550352 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 288/583] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:05 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:06.573668 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-7b8b2155-144d-49e2-9e8a-68f04ee6d6bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:06.574299 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7b8b2155-144d-49e2-9e8a-68f04ee6d6bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:06.580828 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7b8b2155-144d-49e2-9e8a-68f04ee6d6bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:06.581330 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7b8b2155-144d-49e2-9e8a-68f04ee6d6bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:06.581761 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7b8b2155-144d-49e2-9e8a-68f04ee6d6bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:06.582465 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7b8b2155-144d-49e2-9e8a-68f04ee6d6bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:06.582909 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7b8b2155-144d-49e2-9e8a-68f04ee6d6bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:06.583322 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7b8b2155-144d-49e2-9e8a-68f04ee6d6bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:06.715366 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7b8b2155-144d-49e2-9e8a-68f04ee6d6bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:06.723774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7b8b2155-144d-49e2-9e8a-68f04ee6d6bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:06.725287 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7b8b2155-144d-49e2-9e8a-68f04ee6d6bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:06.726762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-7b8b2155-144d-49e2-9e8a-68f04ee6d6bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1720 microversion: 2.20 time: 0.157490 Aug 04 21:45:06.727324 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 296/584] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:06 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:06.798083 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-1a8cd769-579b-4b82-b962-89319608d13e req-86cfcb57-8772-4818-bc54-979b91dec961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87934a42-5a51-4ba4-81ed-d07b785bc090", "name": "network-vif-unplugged", "status": "completed", "tag": "970090cc-8601-489b-8105-e93f171c77d4"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:45:06.809262 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-1a8cd769-579b-4b82-b962-89319608d13e req-86cfcb57-8772-4818-bc54-979b91dec961 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:06.809810 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-1a8cd769-579b-4b82-b962-89319608d13e req-86cfcb57-8772-4818-bc54-979b91dec961 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:06.810261 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-1a8cd769-579b-4b82-b962-89319608d13e req-86cfcb57-8772-4818-bc54-979b91dec961 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:06.823792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-1a8cd769-579b-4b82-b962-89319608d13e req-86cfcb57-8772-4818-bc54-979b91dec961 service nova] Creating event network-vif-unplugged:970090cc-8601-489b-8105-e93f171c77d4 for instance 87934a42-5a51-4ba4-81ed-d07b785bc090 on hv-cinder-85220 Aug 04 21:45:06.827824 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-1a8cd769-579b-4b82-b962-89319608d13e req-86cfcb57-8772-4818-bc54-979b91dec961 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034035 Aug 04 21:45:06.828415 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 289/585] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:45:07.751093 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ef72d761-62b2-4db8-852c-f27bde29e31c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:07.751696 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ef72d761-62b2-4db8-852c-f27bde29e31c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:07.758290 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef72d761-62b2-4db8-852c-f27bde29e31c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:07.758766 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef72d761-62b2-4db8-852c-f27bde29e31c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:07.759201 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef72d761-62b2-4db8-852c-f27bde29e31c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:07.759890 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef72d761-62b2-4db8-852c-f27bde29e31c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:07.760328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef72d761-62b2-4db8-852c-f27bde29e31c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:07.760740 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef72d761-62b2-4db8-852c-f27bde29e31c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:07.906031 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ef72d761-62b2-4db8-852c-f27bde29e31c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:07.915001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ef72d761-62b2-4db8-852c-f27bde29e31c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:07.917234 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ef72d761-62b2-4db8-852c-f27bde29e31c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:07.918795 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ef72d761-62b2-4db8-852c-f27bde29e31c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1720 microversion: 2.20 time: 0.171572 Aug 04 21:45:07.919520 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 297/586] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:07 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:08.943399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-4a25d318-8eb6-4327-830f-dd0dd773ea9a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:08.944091 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-4a25d318-8eb6-4327-830f-dd0dd773ea9a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:08.950903 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4a25d318-8eb6-4327-830f-dd0dd773ea9a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:08.951383 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4a25d318-8eb6-4327-830f-dd0dd773ea9a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:08.951811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4a25d318-8eb6-4327-830f-dd0dd773ea9a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:08.952500 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4a25d318-8eb6-4327-830f-dd0dd773ea9a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:08.952996 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4a25d318-8eb6-4327-830f-dd0dd773ea9a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:08.953417 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4a25d318-8eb6-4327-830f-dd0dd773ea9a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:09.104751 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4a25d318-8eb6-4327-830f-dd0dd773ea9a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:09.113819 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4a25d318-8eb6-4327-830f-dd0dd773ea9a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:09.115769 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4a25d318-8eb6-4327-830f-dd0dd773ea9a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:09.117180 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-4a25d318-8eb6-4327-830f-dd0dd773ea9a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1723 microversion: 2.20 time: 0.178595 Aug 04 21:45:09.118948 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 290/587] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:08 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:09.151859 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4d4b9de1-830c-4051-adf1-9c0f81dea72e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7353d96-cde2-4cc1-ab99-3794d714b3a5"}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:45:09.154311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4d4b9de1-830c-4051-adf1-9c0f81dea72e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:09.160819 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d4b9de1-830c-4051-adf1-9c0f81dea72e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:09.161306 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d4b9de1-830c-4051-adf1-9c0f81dea72e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:09.161943 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d4b9de1-830c-4051-adf1-9c0f81dea72e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:09.162771 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d4b9de1-830c-4051-adf1-9c0f81dea72e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:09.163237 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d4b9de1-830c-4051-adf1-9c0f81dea72e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:09.163642 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d4b9de1-830c-4051-adf1-9c0f81dea72e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:10.003366 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4d4b9de1-830c-4051-adf1-9c0f81dea72e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "POST /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.856251 Aug 04 21:45:10.003983 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 298/588] 10.222.0.73 () {62 vars in 1364 bytes} [Thu Aug 4 21:45:09 2022] POST /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090/os-volume_attachments => generated 188 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:45:10.137810 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a5cdc928-f3f3-4b45-99ad-ce0cf9af7a97 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:45:10.138467 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a5cdc928-f3f3-4b45-99ad-ce0cf9af7a97 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:10.145137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a5cdc928-f3f3-4b45-99ad-ce0cf9af7a97 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:10.148331 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a5cdc928-f3f3-4b45-99ad-ce0cf9af7a97 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:10.148331 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a5cdc928-f3f3-4b45-99ad-ce0cf9af7a97 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:10.148331 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a5cdc928-f3f3-4b45-99ad-ce0cf9af7a97 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:10.148331 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a5cdc928-f3f3-4b45-99ad-ce0cf9af7a97 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:10.148675 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a5cdc928-f3f3-4b45-99ad-ce0cf9af7a97 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:10.191231 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a5cdc928-f3f3-4b45-99ad-ce0cf9af7a97 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=136341) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 21:45:10.543380 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a5cdc928-f3f3-4b45-99ad-ce0cf9af7a97 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "POST /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090/action" status: 202 len: 0 microversion: 2.20 time: 0.410240 Aug 04 21:45:10.544013 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 291/589] 10.222.0.73 () {62 vars in 1319 bytes} [Thu Aug 4 21:45:10 2022] POST /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:45:10.552541 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-056508d1-f368-430a-927e-aca3196a90e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:10.553269 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-056508d1-f368-430a-927e-aca3196a90e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:10.564130 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-056508d1-f368-430a-927e-aca3196a90e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:10.564130 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-056508d1-f368-430a-927e-aca3196a90e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:10.564130 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-056508d1-f368-430a-927e-aca3196a90e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:10.564130 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-056508d1-f368-430a-927e-aca3196a90e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:10.564470 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-056508d1-f368-430a-927e-aca3196a90e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:10.564470 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-056508d1-f368-430a-927e-aca3196a90e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:10.708391 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-056508d1-f368-430a-927e-aca3196a90e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:10.717678 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-056508d1-f368-430a-927e-aca3196a90e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:10.719553 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-056508d1-f368-430a-927e-aca3196a90e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:10.721996 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-056508d1-f368-430a-927e-aca3196a90e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1749 microversion: 2.20 time: 0.173600 Aug 04 21:45:10.723125 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 299/590] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:10 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1749 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:11.747609 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-95c6aecc-7257-4d86-a53b-c3435c86dbb4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:11.748216 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-95c6aecc-7257-4d86-a53b-c3435c86dbb4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:11.754653 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-95c6aecc-7257-4d86-a53b-c3435c86dbb4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:11.755207 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-95c6aecc-7257-4d86-a53b-c3435c86dbb4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:11.755642 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-95c6aecc-7257-4d86-a53b-c3435c86dbb4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:11.756386 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-95c6aecc-7257-4d86-a53b-c3435c86dbb4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:11.756831 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-95c6aecc-7257-4d86-a53b-c3435c86dbb4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:11.757243 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-95c6aecc-7257-4d86-a53b-c3435c86dbb4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:11.891798 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-95c6aecc-7257-4d86-a53b-c3435c86dbb4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:11.900173 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-95c6aecc-7257-4d86-a53b-c3435c86dbb4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:11.902338 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-95c6aecc-7257-4d86-a53b-c3435c86dbb4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:11.903501 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-95c6aecc-7257-4d86-a53b-c3435c86dbb4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1749 microversion: 2.20 time: 0.161535 Aug 04 21:45:11.904042 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 292/591] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:11 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:12.926762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b748e4b9-b5fc-4596-ada5-696d0488eb84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:12.927361 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b748e4b9-b5fc-4596-ada5-696d0488eb84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:12.934617 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b748e4b9-b5fc-4596-ada5-696d0488eb84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:12.935093 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b748e4b9-b5fc-4596-ada5-696d0488eb84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:12.935520 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b748e4b9-b5fc-4596-ada5-696d0488eb84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:12.936204 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b748e4b9-b5fc-4596-ada5-696d0488eb84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:12.936650 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b748e4b9-b5fc-4596-ada5-696d0488eb84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:12.937072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b748e4b9-b5fc-4596-ada5-696d0488eb84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:13.069959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b748e4b9-b5fc-4596-ada5-696d0488eb84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:13.078953 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b748e4b9-b5fc-4596-ada5-696d0488eb84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:13.080460 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b748e4b9-b5fc-4596-ada5-696d0488eb84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:13.081668 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b748e4b9-b5fc-4596-ada5-696d0488eb84 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1751 microversion: 2.20 time: 0.158817 Aug 04 21:45:13.082279 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 300/592] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:12 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:14.104149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d8325009-e4cc-4c96-a4fa-0230b36b6bff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:14.104672 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-d8325009-e4cc-4c96-a4fa-0230b36b6bff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:14.111703 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d8325009-e4cc-4c96-a4fa-0230b36b6bff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:14.111905 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d8325009-e4cc-4c96-a4fa-0230b36b6bff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:14.112245 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d8325009-e4cc-4c96-a4fa-0230b36b6bff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:14.112934 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d8325009-e4cc-4c96-a4fa-0230b36b6bff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:14.113382 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d8325009-e4cc-4c96-a4fa-0230b36b6bff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:14.113795 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d8325009-e4cc-4c96-a4fa-0230b36b6bff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:14.258048 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d8325009-e4cc-4c96-a4fa-0230b36b6bff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:14.267264 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d8325009-e4cc-4c96-a4fa-0230b36b6bff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:14.268786 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d8325009-e4cc-4c96-a4fa-0230b36b6bff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:14.269925 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d8325009-e4cc-4c96-a4fa-0230b36b6bff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.169938 Aug 04 21:45:14.270513 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 293/593] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:14 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:15.299253 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2e2e26f2-b5e3-40e7-8ca9-dc7edb84f53a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:15.299849 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2e2e26f2-b5e3-40e7-8ca9-dc7edb84f53a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:15.301889 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=34 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:45:15.306503 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2e2e26f2-b5e3-40e7-8ca9-dc7edb84f53a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:15.307238 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2e2e26f2-b5e3-40e7-8ca9-dc7edb84f53a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:15.307565 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2e2e26f2-b5e3-40e7-8ca9-dc7edb84f53a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:15.308244 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2e2e26f2-b5e3-40e7-8ca9-dc7edb84f53a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:15.308687 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2e2e26f2-b5e3-40e7-8ca9-dc7edb84f53a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:15.309137 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2e2e26f2-b5e3-40e7-8ca9-dc7edb84f53a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:15.450833 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2e2e26f2-b5e3-40e7-8ca9-dc7edb84f53a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:15.459124 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2e2e26f2-b5e3-40e7-8ca9-dc7edb84f53a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:15.460774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2e2e26f2-b5e3-40e7-8ca9-dc7edb84f53a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:15.461943 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2e2e26f2-b5e3-40e7-8ca9-dc7edb84f53a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.166510 Aug 04 21:45:15.462520 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 301/594] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:15 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:16.485271 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-3820565c-594b-43e4-bfa2-c2b7f57057a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:16.486537 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-3820565c-594b-43e4-bfa2-c2b7f57057a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:16.489283 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:45:16.494336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3820565c-594b-43e4-bfa2-c2b7f57057a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:16.495769 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3820565c-594b-43e4-bfa2-c2b7f57057a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:16.496221 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3820565c-594b-43e4-bfa2-c2b7f57057a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:16.501232 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3820565c-594b-43e4-bfa2-c2b7f57057a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:16.501232 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3820565c-594b-43e4-bfa2-c2b7f57057a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:16.501232 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3820565c-594b-43e4-bfa2-c2b7f57057a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:16.819974 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-3820565c-594b-43e4-bfa2-c2b7f57057a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:16.830269 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-3820565c-594b-43e4-bfa2-c2b7f57057a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:16.832132 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-3820565c-594b-43e4-bfa2-c2b7f57057a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:16.833601 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-3820565c-594b-43e4-bfa2-c2b7f57057a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.352423 Aug 04 21:45:16.852200 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 294/595] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:16 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:17.860054 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-445298c4-5526-4178-978f-92a283232a08 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:17.860738 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-445298c4-5526-4178-978f-92a283232a08 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:17.867625 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-445298c4-5526-4178-978f-92a283232a08 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:17.868254 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-445298c4-5526-4178-978f-92a283232a08 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:17.868878 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-445298c4-5526-4178-978f-92a283232a08 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:17.870297 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-445298c4-5526-4178-978f-92a283232a08 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:17.871016 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-445298c4-5526-4178-978f-92a283232a08 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:17.871439 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-445298c4-5526-4178-978f-92a283232a08 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:18.085473 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-445298c4-5526-4178-978f-92a283232a08 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:18.094480 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-445298c4-5526-4178-978f-92a283232a08 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:18.096218 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-445298c4-5526-4178-978f-92a283232a08 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:18.097550 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-445298c4-5526-4178-978f-92a283232a08 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.241366 Aug 04 21:45:18.098235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 302/596] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:17 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:19.122850 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-78a4c9f3-231c-429a-8b2f-d2ff959ecb01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:19.124342 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-78a4c9f3-231c-429a-8b2f-d2ff959ecb01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:19.130746 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-78a4c9f3-231c-429a-8b2f-d2ff959ecb01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:19.131228 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-78a4c9f3-231c-429a-8b2f-d2ff959ecb01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:19.131657 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-78a4c9f3-231c-429a-8b2f-d2ff959ecb01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:19.132348 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-78a4c9f3-231c-429a-8b2f-d2ff959ecb01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:19.132794 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-78a4c9f3-231c-429a-8b2f-d2ff959ecb01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:19.133208 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-78a4c9f3-231c-429a-8b2f-d2ff959ecb01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:19.548851 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-78a4c9f3-231c-429a-8b2f-d2ff959ecb01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:19.559246 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-78a4c9f3-231c-429a-8b2f-d2ff959ecb01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:19.561192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-78a4c9f3-231c-429a-8b2f-d2ff959ecb01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:19.562678 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-78a4c9f3-231c-429a-8b2f-d2ff959ecb01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.445566 Aug 04 21:45:19.563273 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 295/597] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:19 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:20.588344 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b56c0d00-0d48-452f-9f2e-bf60707763bd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:20.589921 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b56c0d00-0d48-452f-9f2e-bf60707763bd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:20.596799 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b56c0d00-0d48-452f-9f2e-bf60707763bd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:20.597285 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b56c0d00-0d48-452f-9f2e-bf60707763bd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:20.597717 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b56c0d00-0d48-452f-9f2e-bf60707763bd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:20.598438 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b56c0d00-0d48-452f-9f2e-bf60707763bd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:20.598888 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b56c0d00-0d48-452f-9f2e-bf60707763bd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:20.599311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b56c0d00-0d48-452f-9f2e-bf60707763bd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:20.740032 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b56c0d00-0d48-452f-9f2e-bf60707763bd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:20.749878 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b56c0d00-0d48-452f-9f2e-bf60707763bd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:20.756001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b56c0d00-0d48-452f-9f2e-bf60707763bd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:20.756001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b56c0d00-0d48-452f-9f2e-bf60707763bd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.168664 Aug 04 21:45:20.756001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 303/598] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:20 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:21.778675 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-04843c8a-a91f-4c35-bcf9-63faa5e3046d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:21.779708 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-04843c8a-a91f-4c35-bcf9-63faa5e3046d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:21.789838 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-04843c8a-a91f-4c35-bcf9-63faa5e3046d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:21.790698 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-04843c8a-a91f-4c35-bcf9-63faa5e3046d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:21.791457 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-04843c8a-a91f-4c35-bcf9-63faa5e3046d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:21.792624 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-04843c8a-a91f-4c35-bcf9-63faa5e3046d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:21.793379 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-04843c8a-a91f-4c35-bcf9-63faa5e3046d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:21.794295 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-04843c8a-a91f-4c35-bcf9-63faa5e3046d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:21.939747 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-04843c8a-a91f-4c35-bcf9-63faa5e3046d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:21.948361 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-04843c8a-a91f-4c35-bcf9-63faa5e3046d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:21.949938 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-04843c8a-a91f-4c35-bcf9-63faa5e3046d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:21.951117 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-04843c8a-a91f-4c35-bcf9-63faa5e3046d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.177806 Aug 04 21:45:21.951671 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 296/599] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:21 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:22.977268 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-84562e53-ac23-4e72-a215-55af21d08541 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:22.978333 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-84562e53-ac23-4e72-a215-55af21d08541 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:22.987035 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-84562e53-ac23-4e72-a215-55af21d08541 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:22.987860 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-84562e53-ac23-4e72-a215-55af21d08541 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:22.988571 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-84562e53-ac23-4e72-a215-55af21d08541 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:22.989732 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-84562e53-ac23-4e72-a215-55af21d08541 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:22.990554 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-84562e53-ac23-4e72-a215-55af21d08541 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:22.991262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-84562e53-ac23-4e72-a215-55af21d08541 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:23.147702 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-84562e53-ac23-4e72-a215-55af21d08541 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:23.157058 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-84562e53-ac23-4e72-a215-55af21d08541 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:23.158597 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-84562e53-ac23-4e72-a215-55af21d08541 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:23.159930 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-84562e53-ac23-4e72-a215-55af21d08541 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.189022 Aug 04 21:45:23.165317 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 304/600] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:22 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:24.185559 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d71cb016-fada-4722-8a2f-32481e718f8b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:24.186228 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-d71cb016-fada-4722-8a2f-32481e718f8b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:24.200064 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d71cb016-fada-4722-8a2f-32481e718f8b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:24.200637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d71cb016-fada-4722-8a2f-32481e718f8b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:24.201130 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d71cb016-fada-4722-8a2f-32481e718f8b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:24.201902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d71cb016-fada-4722-8a2f-32481e718f8b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:24.202448 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d71cb016-fada-4722-8a2f-32481e718f8b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:24.202869 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d71cb016-fada-4722-8a2f-32481e718f8b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:24.357396 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d71cb016-fada-4722-8a2f-32481e718f8b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:24.367599 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d71cb016-fada-4722-8a2f-32481e718f8b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:24.369541 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d71cb016-fada-4722-8a2f-32481e718f8b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:24.371702 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d71cb016-fada-4722-8a2f-32481e718f8b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.190823 Aug 04 21:45:24.372717 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 297/601] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:24 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:25.395715 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-39b74af3-9011-47e4-8f79-780b74fe4089 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:25.396374 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-39b74af3-9011-47e4-8f79-780b74fe4089 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:25.407934 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-39b74af3-9011-47e4-8f79-780b74fe4089 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:25.410810 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-39b74af3-9011-47e4-8f79-780b74fe4089 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:25.410810 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-39b74af3-9011-47e4-8f79-780b74fe4089 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:25.410810 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-39b74af3-9011-47e4-8f79-780b74fe4089 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:25.410810 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-39b74af3-9011-47e4-8f79-780b74fe4089 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:25.411236 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-39b74af3-9011-47e4-8f79-780b74fe4089 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:25.560178 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-39b74af3-9011-47e4-8f79-780b74fe4089 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:25.569218 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-39b74af3-9011-47e4-8f79-780b74fe4089 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:25.571014 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-39b74af3-9011-47e4-8f79-780b74fe4089 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:25.572278 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-39b74af3-9011-47e4-8f79-780b74fe4089 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.180418 Aug 04 21:45:25.582276 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 305/602] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:25 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:26.601398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e679ca01-3f42-40ce-a776-dd379be04fc1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:26.602071 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e679ca01-3f42-40ce-a776-dd379be04fc1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:26.609276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e679ca01-3f42-40ce-a776-dd379be04fc1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:26.609755 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e679ca01-3f42-40ce-a776-dd379be04fc1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:26.610241 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e679ca01-3f42-40ce-a776-dd379be04fc1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:26.610930 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e679ca01-3f42-40ce-a776-dd379be04fc1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:26.611374 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e679ca01-3f42-40ce-a776-dd379be04fc1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:26.611790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e679ca01-3f42-40ce-a776-dd379be04fc1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:26.772192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e679ca01-3f42-40ce-a776-dd379be04fc1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:26.780549 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e679ca01-3f42-40ce-a776-dd379be04fc1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:26.782099 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e679ca01-3f42-40ce-a776-dd379be04fc1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:26.783261 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e679ca01-3f42-40ce-a776-dd379be04fc1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.186003 Aug 04 21:45:26.784004 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 298/603] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:26 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:27.501401 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:45:27.501718 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Thu Aug 4 21:45:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:45:27.807980 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-61128cc0-e0a7-4917-a82c-a7f5dce9d5ce tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:27.808742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-61128cc0-e0a7-4917-a82c-a7f5dce9d5ce tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:27.815236 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-61128cc0-e0a7-4917-a82c-a7f5dce9d5ce tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:27.815735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-61128cc0-e0a7-4917-a82c-a7f5dce9d5ce tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:27.816219 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-61128cc0-e0a7-4917-a82c-a7f5dce9d5ce tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:27.816930 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-61128cc0-e0a7-4917-a82c-a7f5dce9d5ce tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:27.817388 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-61128cc0-e0a7-4917-a82c-a7f5dce9d5ce tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:27.817808 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-61128cc0-e0a7-4917-a82c-a7f5dce9d5ce tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:27.956303 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-61128cc0-e0a7-4917-a82c-a7f5dce9d5ce tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:27.965192 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-61128cc0-e0a7-4917-a82c-a7f5dce9d5ce tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:27.966833 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-61128cc0-e0a7-4917-a82c-a7f5dce9d5ce tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:27.967976 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-61128cc0-e0a7-4917-a82c-a7f5dce9d5ce tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.164551 Aug 04 21:45:27.968523 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 306/604] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:27 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:28.991863 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-692ac85d-27b6-4d40-a415-fe0d1d8cc5a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:28.992465 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-692ac85d-27b6-4d40-a415-fe0d1d8cc5a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:29.000010 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-692ac85d-27b6-4d40-a415-fe0d1d8cc5a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:29.000491 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-692ac85d-27b6-4d40-a415-fe0d1d8cc5a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:29.000919 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-692ac85d-27b6-4d40-a415-fe0d1d8cc5a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:29.001606 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-692ac85d-27b6-4d40-a415-fe0d1d8cc5a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:29.002072 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-692ac85d-27b6-4d40-a415-fe0d1d8cc5a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:29.002491 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-692ac85d-27b6-4d40-a415-fe0d1d8cc5a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:29.005032 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:45:29.136834 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-692ac85d-27b6-4d40-a415-fe0d1d8cc5a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:29.145279 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-692ac85d-27b6-4d40-a415-fe0d1d8cc5a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:29.146864 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-692ac85d-27b6-4d40-a415-fe0d1d8cc5a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:29.148014 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-692ac85d-27b6-4d40-a415-fe0d1d8cc5a3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.160186 Aug 04 21:45:29.148559 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 299/605] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:28 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:30.172124 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8e94ebdb-ed7c-4846-91d1-0e1dd145cf2b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:30.172805 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8e94ebdb-ed7c-4846-91d1-0e1dd145cf2b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:30.179130 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8e94ebdb-ed7c-4846-91d1-0e1dd145cf2b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:30.179611 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8e94ebdb-ed7c-4846-91d1-0e1dd145cf2b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:30.180043 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8e94ebdb-ed7c-4846-91d1-0e1dd145cf2b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:30.180737 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8e94ebdb-ed7c-4846-91d1-0e1dd145cf2b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:30.181185 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8e94ebdb-ed7c-4846-91d1-0e1dd145cf2b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:30.181606 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8e94ebdb-ed7c-4846-91d1-0e1dd145cf2b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:30.310477 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8e94ebdb-ed7c-4846-91d1-0e1dd145cf2b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:30.318937 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8e94ebdb-ed7c-4846-91d1-0e1dd145cf2b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:30.320447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8e94ebdb-ed7c-4846-91d1-0e1dd145cf2b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:30.321600 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8e94ebdb-ed7c-4846-91d1-0e1dd145cf2b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.153374 Aug 04 21:45:30.322183 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 307/606] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:30 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:31.346699 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e9988fd5-7e5c-4122-8ff8-c327725d0bcc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:31.347304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e9988fd5-7e5c-4122-8ff8-c327725d0bcc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:31.353930 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e9988fd5-7e5c-4122-8ff8-c327725d0bcc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:31.354446 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e9988fd5-7e5c-4122-8ff8-c327725d0bcc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:31.354929 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e9988fd5-7e5c-4122-8ff8-c327725d0bcc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:31.355616 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e9988fd5-7e5c-4122-8ff8-c327725d0bcc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:31.356056 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e9988fd5-7e5c-4122-8ff8-c327725d0bcc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:31.356471 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e9988fd5-7e5c-4122-8ff8-c327725d0bcc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:31.486802 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e9988fd5-7e5c-4122-8ff8-c327725d0bcc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:31.495775 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e9988fd5-7e5c-4122-8ff8-c327725d0bcc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:31.497295 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e9988fd5-7e5c-4122-8ff8-c327725d0bcc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:31.498483 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e9988fd5-7e5c-4122-8ff8-c327725d0bcc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.155749 Aug 04 21:45:31.499032 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 300/607] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:31 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:32.522036 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-788e2f22-fef8-42e8-b389-df27d40bfdd0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:32.522681 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-788e2f22-fef8-42e8-b389-df27d40bfdd0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:32.530228 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-788e2f22-fef8-42e8-b389-df27d40bfdd0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:32.530712 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-788e2f22-fef8-42e8-b389-df27d40bfdd0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:32.531142 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-788e2f22-fef8-42e8-b389-df27d40bfdd0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:32.531839 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-788e2f22-fef8-42e8-b389-df27d40bfdd0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:32.532285 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-788e2f22-fef8-42e8-b389-df27d40bfdd0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:32.532708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-788e2f22-fef8-42e8-b389-df27d40bfdd0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:33.116572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-788e2f22-fef8-42e8-b389-df27d40bfdd0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:33.120042 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:45:33.125538 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-788e2f22-fef8-42e8-b389-df27d40bfdd0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:33.127055 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-788e2f22-fef8-42e8-b389-df27d40bfdd0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:33.128199 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-788e2f22-fef8-42e8-b389-df27d40bfdd0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.610076 Aug 04 21:45:33.128758 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 308/608] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:32 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:34.151480 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-abab1333-22b6-4532-b6ca-7ae9a2c9ee52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:34.152072 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-abab1333-22b6-4532-b6ca-7ae9a2c9ee52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:34.158597 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-abab1333-22b6-4532-b6ca-7ae9a2c9ee52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:34.159076 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-abab1333-22b6-4532-b6ca-7ae9a2c9ee52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:34.159504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-abab1333-22b6-4532-b6ca-7ae9a2c9ee52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:34.160300 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-abab1333-22b6-4532-b6ca-7ae9a2c9ee52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:34.160744 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-abab1333-22b6-4532-b6ca-7ae9a2c9ee52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:34.161159 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-abab1333-22b6-4532-b6ca-7ae9a2c9ee52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:34.289678 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-abab1333-22b6-4532-b6ca-7ae9a2c9ee52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:34.298769 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-abab1333-22b6-4532-b6ca-7ae9a2c9ee52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:34.300268 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-abab1333-22b6-4532-b6ca-7ae9a2c9ee52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:34.301429 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-abab1333-22b6-4532-b6ca-7ae9a2c9ee52 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.153872 Aug 04 21:45:34.301973 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 301/609] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:34 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:35.165257 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:45:35.165817 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Thu Aug 4 21:45:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:45:35.325456 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-78e97821-69d3-498b-9886-f47a660b0ded tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:35.326086 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-78e97821-69d3-498b-9886-f47a660b0ded tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:35.333075 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-78e97821-69d3-498b-9886-f47a660b0ded tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:35.335453 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-78e97821-69d3-498b-9886-f47a660b0ded tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:35.335453 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-78e97821-69d3-498b-9886-f47a660b0ded tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:35.335453 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-78e97821-69d3-498b-9886-f47a660b0ded tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:35.335453 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-78e97821-69d3-498b-9886-f47a660b0ded tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:35.335894 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-78e97821-69d3-498b-9886-f47a660b0ded tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:35.465013 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-78e97821-69d3-498b-9886-f47a660b0ded tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:35.473220 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-78e97821-69d3-498b-9886-f47a660b0ded tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:35.474742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-78e97821-69d3-498b-9886-f47a660b0ded tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:35.475876 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-78e97821-69d3-498b-9886-f47a660b0ded tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.155108 Aug 04 21:45:35.476418 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 309/610] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:35 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:36.498583 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-01ce20b7-87a3-44b1-aae0-dfdd2c2ca542 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:36.499178 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-01ce20b7-87a3-44b1-aae0-dfdd2c2ca542 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:36.505475 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-01ce20b7-87a3-44b1-aae0-dfdd2c2ca542 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:36.505946 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-01ce20b7-87a3-44b1-aae0-dfdd2c2ca542 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:36.506404 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-01ce20b7-87a3-44b1-aae0-dfdd2c2ca542 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:36.507074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-01ce20b7-87a3-44b1-aae0-dfdd2c2ca542 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:36.507514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-01ce20b7-87a3-44b1-aae0-dfdd2c2ca542 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:36.507927 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-01ce20b7-87a3-44b1-aae0-dfdd2c2ca542 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:36.642444 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-01ce20b7-87a3-44b1-aae0-dfdd2c2ca542 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:36.651567 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-01ce20b7-87a3-44b1-aae0-dfdd2c2ca542 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:36.653193 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-01ce20b7-87a3-44b1-aae0-dfdd2c2ca542 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:36.654445 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-01ce20b7-87a3-44b1-aae0-dfdd2c2ca542 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.160047 Aug 04 21:45:36.654993 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 302/611] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:36 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:37.678992 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-9da0d8ff-e04d-45e6-a37a-30d1e611372b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:37.682381 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-9da0d8ff-e04d-45e6-a37a-30d1e611372b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:37.686924 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9da0d8ff-e04d-45e6-a37a-30d1e611372b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:37.687393 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9da0d8ff-e04d-45e6-a37a-30d1e611372b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:37.687825 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9da0d8ff-e04d-45e6-a37a-30d1e611372b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:37.688510 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9da0d8ff-e04d-45e6-a37a-30d1e611372b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:37.688956 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9da0d8ff-e04d-45e6-a37a-30d1e611372b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:37.689378 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9da0d8ff-e04d-45e6-a37a-30d1e611372b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:37.829606 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-9da0d8ff-e04d-45e6-a37a-30d1e611372b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:37.838092 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-9da0d8ff-e04d-45e6-a37a-30d1e611372b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:37.840527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-9da0d8ff-e04d-45e6-a37a-30d1e611372b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:37.841664 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-9da0d8ff-e04d-45e6-a37a-30d1e611372b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.166528 Aug 04 21:45:37.842239 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 310/612] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:37 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:45:38.864581 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-8beb5c07-64af-40db-886a-635214934ade tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:38.865372 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-8beb5c07-64af-40db-886a-635214934ade tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:38.874078 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8beb5c07-64af-40db-886a-635214934ade tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:38.874746 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8beb5c07-64af-40db-886a-635214934ade tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:38.875329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8beb5c07-64af-40db-886a-635214934ade tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:38.876431 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8beb5c07-64af-40db-886a-635214934ade tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:38.877397 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8beb5c07-64af-40db-886a-635214934ade tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:38.877924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8beb5c07-64af-40db-886a-635214934ade tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:39.030450 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8beb5c07-64af-40db-886a-635214934ade tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:39.051930 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8beb5c07-64af-40db-886a-635214934ade tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:39.051930 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8beb5c07-64af-40db-886a-635214934ade tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:39.051930 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-8beb5c07-64af-40db-886a-635214934ade tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.181002 Aug 04 21:45:39.052428 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 303/613] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:38 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:45:40.064446 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4d469a5f-22e5-4163-b1fd-15cf3809bde2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:40.065046 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4d469a5f-22e5-4163-b1fd-15cf3809bde2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:40.071519 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d469a5f-22e5-4163-b1fd-15cf3809bde2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:40.071996 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d469a5f-22e5-4163-b1fd-15cf3809bde2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:40.072424 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d469a5f-22e5-4163-b1fd-15cf3809bde2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:40.073324 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d469a5f-22e5-4163-b1fd-15cf3809bde2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:40.073769 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d469a5f-22e5-4163-b1fd-15cf3809bde2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:40.074219 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d469a5f-22e5-4163-b1fd-15cf3809bde2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:40.214389 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4d469a5f-22e5-4163-b1fd-15cf3809bde2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:40.223150 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4d469a5f-22e5-4163-b1fd-15cf3809bde2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:40.224659 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4d469a5f-22e5-4163-b1fd-15cf3809bde2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:40.225821 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4d469a5f-22e5-4163-b1fd-15cf3809bde2 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.165223 Aug 04 21:45:40.226401 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 311/614] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:40 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:41.250694 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-8623e969-4aad-4995-bce9-b5e85b32135c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:41.252357 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-8623e969-4aad-4995-bce9-b5e85b32135c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:41.259543 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8623e969-4aad-4995-bce9-b5e85b32135c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:41.261334 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8623e969-4aad-4995-bce9-b5e85b32135c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:41.261334 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8623e969-4aad-4995-bce9-b5e85b32135c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:41.261334 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8623e969-4aad-4995-bce9-b5e85b32135c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:41.267054 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-8437bd2b-f704-453a-b896-21c86a71444a req-db18b261-495d-41f4-b752-b35448e07b78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87934a42-5a51-4ba4-81ed-d07b785bc090", "name": "network-vif-plugged", "status": "completed", "tag": "970090cc-8601-489b-8105-e93f171c77d4"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:45:41.274066 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8623e969-4aad-4995-bce9-b5e85b32135c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:41.274584 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8623e969-4aad-4995-bce9-b5e85b32135c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:41.278846 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-8437bd2b-f704-453a-b896-21c86a71444a req-db18b261-495d-41f4-b752-b35448e07b78 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:41.279326 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-8437bd2b-f704-453a-b896-21c86a71444a req-db18b261-495d-41f4-b752-b35448e07b78 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:41.280032 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-8437bd2b-f704-453a-b896-21c86a71444a req-db18b261-495d-41f4-b752-b35448e07b78 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:41.293363 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-8437bd2b-f704-453a-b896-21c86a71444a req-db18b261-495d-41f4-b752-b35448e07b78 service nova] Creating event network-vif-plugged:970090cc-8601-489b-8105-e93f171c77d4 for instance 87934a42-5a51-4ba4-81ed-d07b785bc090 on hv-cinder-85220 Aug 04 21:45:41.299200 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-8437bd2b-f704-453a-b896-21c86a71444a req-db18b261-495d-41f4-b752-b35448e07b78 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035763 Aug 04 21:45:41.299799 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 312/615] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:45:41.420461 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8623e969-4aad-4995-bce9-b5e85b32135c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:41.429418 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8623e969-4aad-4995-bce9-b5e85b32135c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:41.430980 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8623e969-4aad-4995-bce9-b5e85b32135c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:41.432302 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-8623e969-4aad-4995-bce9-b5e85b32135c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.185584 Aug 04 21:45:41.433180 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 304/616] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:41 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:42.456564 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-68ad1d91-0145-4012-be36-f1a4cc64bab5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:42.457255 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-68ad1d91-0145-4012-be36-f1a4cc64bab5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:42.464337 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-68ad1d91-0145-4012-be36-f1a4cc64bab5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:42.464826 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-68ad1d91-0145-4012-be36-f1a4cc64bab5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:42.465258 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-68ad1d91-0145-4012-be36-f1a4cc64bab5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:42.465942 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-68ad1d91-0145-4012-be36-f1a4cc64bab5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:42.466418 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-68ad1d91-0145-4012-be36-f1a4cc64bab5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:42.466840 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-68ad1d91-0145-4012-be36-f1a4cc64bab5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:42.597475 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-68ad1d91-0145-4012-be36-f1a4cc64bab5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:42.605989 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-68ad1d91-0145-4012-be36-f1a4cc64bab5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:42.607509 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-68ad1d91-0145-4012-be36-f1a4cc64bab5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:42.608649 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-68ad1d91-0145-4012-be36-f1a4cc64bab5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.156835 Aug 04 21:45:42.609201 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 313/617] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:42 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:43.632247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-af9505cd-7420-44ef-bed0-f4846222d8bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:43.632785 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-af9505cd-7420-44ef-bed0-f4846222d8bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:43.639659 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-af9505cd-7420-44ef-bed0-f4846222d8bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:43.640130 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-af9505cd-7420-44ef-bed0-f4846222d8bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:43.640556 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-af9505cd-7420-44ef-bed0-f4846222d8bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:43.641230 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-af9505cd-7420-44ef-bed0-f4846222d8bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:43.641672 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-af9505cd-7420-44ef-bed0-f4846222d8bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:43.642143 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-af9505cd-7420-44ef-bed0-f4846222d8bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:43.769092 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-af9505cd-7420-44ef-bed0-f4846222d8bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:43.778256 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-af9505cd-7420-44ef-bed0-f4846222d8bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:43.779745 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-af9505cd-7420-44ef-bed0-f4846222d8bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:43.781084 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-af9505cd-7420-44ef-bed0-f4846222d8bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.152724 Aug 04 21:45:43.781633 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 305/618] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:43 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:44.803922 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d9e8ef7a-0e03-4f33-999d-261df3283ca0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:44.804675 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d9e8ef7a-0e03-4f33-999d-261df3283ca0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:44.811477 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d9e8ef7a-0e03-4f33-999d-261df3283ca0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:44.811969 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d9e8ef7a-0e03-4f33-999d-261df3283ca0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:44.812427 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d9e8ef7a-0e03-4f33-999d-261df3283ca0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:44.813126 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d9e8ef7a-0e03-4f33-999d-261df3283ca0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:44.813579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d9e8ef7a-0e03-4f33-999d-261df3283ca0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:44.814028 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d9e8ef7a-0e03-4f33-999d-261df3283ca0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:44.943755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d9e8ef7a-0e03-4f33-999d-261df3283ca0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:44.952736 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d9e8ef7a-0e03-4f33-999d-261df3283ca0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:44.954326 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d9e8ef7a-0e03-4f33-999d-261df3283ca0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:44.955531 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d9e8ef7a-0e03-4f33-999d-261df3283ca0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.155691 Aug 04 21:45:44.956091 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 314/619] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:44 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:45.980269 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-cf64d9e2-2d52-487d-8b00-c03df66e8c01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:45.980883 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-cf64d9e2-2d52-487d-8b00-c03df66e8c01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:45.987521 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cf64d9e2-2d52-487d-8b00-c03df66e8c01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:45.988009 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cf64d9e2-2d52-487d-8b00-c03df66e8c01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:45.988486 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cf64d9e2-2d52-487d-8b00-c03df66e8c01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:45.989180 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cf64d9e2-2d52-487d-8b00-c03df66e8c01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:45.989627 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cf64d9e2-2d52-487d-8b00-c03df66e8c01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:45.990072 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cf64d9e2-2d52-487d-8b00-c03df66e8c01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:46.131402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-cf64d9e2-2d52-487d-8b00-c03df66e8c01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:46.139934 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-cf64d9e2-2d52-487d-8b00-c03df66e8c01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:46.141427 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-cf64d9e2-2d52-487d-8b00-c03df66e8c01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:46.142602 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-cf64d9e2-2d52-487d-8b00-c03df66e8c01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1807 microversion: 2.20 time: 0.166940 Aug 04 21:45:46.143156 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 306/620] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:45 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:47.164680 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-15415f2c-e6ea-4b7a-ab1b-62fd88f7e5e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:45:47.165274 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-15415f2c-e6ea-4b7a-ab1b-62fd88f7e5e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:47.168428 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=28 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:45:47.173033 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-15415f2c-e6ea-4b7a-ab1b-62fd88f7e5e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:47.173507 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-15415f2c-e6ea-4b7a-ab1b-62fd88f7e5e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:47.173935 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-15415f2c-e6ea-4b7a-ab1b-62fd88f7e5e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:47.174641 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-15415f2c-e6ea-4b7a-ab1b-62fd88f7e5e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:47.175083 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-15415f2c-e6ea-4b7a-ab1b-62fd88f7e5e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:47.175505 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-15415f2c-e6ea-4b7a-ab1b-62fd88f7e5e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:47.307404 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-15415f2c-e6ea-4b7a-ab1b-62fd88f7e5e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:47.315758 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-15415f2c-e6ea-4b7a-ab1b-62fd88f7e5e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:47.317250 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-15415f2c-e6ea-4b7a-ab1b-62fd88f7e5e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:45:47.318423 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-15415f2c-e6ea-4b7a-ab1b-62fd88f7e5e1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1794 microversion: 2.20 time: 0.157574 Aug 04 21:45:47.318982 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 315/621] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:45:47 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1794 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:45:57.557604 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=25 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:45:57.558312 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=47 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:45:57.720098 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-895e3d44-2e49-4e61-8285-aa133db5e063 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "153efaff-2cf0-4272-8ab7-6ac4024ff7f5"}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:45:57.722594 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-895e3d44-2e49-4e61-8285-aa133db5e063 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:45:57.728446 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-895e3d44-2e49-4e61-8285-aa133db5e063 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:57.732472 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-895e3d44-2e49-4e61-8285-aa133db5e063 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:57.732472 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-895e3d44-2e49-4e61-8285-aa133db5e063 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:57.732472 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-895e3d44-2e49-4e61-8285-aa133db5e063 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:45:57.732472 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-895e3d44-2e49-4e61-8285-aa133db5e063 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:45:57.732890 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-895e3d44-2e49-4e61-8285-aa133db5e063 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:45:58.533253 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-895e3d44-2e49-4e61-8285-aa133db5e063 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "POST /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.980182 Aug 04 21:45:58.534479 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 307/622] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 4 21:45:57 2022] POST /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad/os-volume_attachments => generated 194 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:46:07.105706 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ecccbe50-fa9e-418f-bf54-846db5618c65 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:46:07.107935 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ecccbe50-fa9e-418f-bf54-846db5618c65 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:07.110384 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=1 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:46:07.111025 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=38 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:46:07.115732 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ecccbe50-fa9e-418f-bf54-846db5618c65 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:07.116211 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ecccbe50-fa9e-418f-bf54-846db5618c65 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:07.116643 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ecccbe50-fa9e-418f-bf54-846db5618c65 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:07.117325 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ecccbe50-fa9e-418f-bf54-846db5618c65 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:07.117773 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ecccbe50-fa9e-418f-bf54-846db5618c65 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:07.118235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ecccbe50-fa9e-418f-bf54-846db5618c65 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:07.140957 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-ecccbe50-fa9e-418f-bf54-846db5618c65 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lazy-loading 'flavor' on Instance uuid c72a9092-7229-4677-9e8c-1849b5f3aaad {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:46:07.452206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ecccbe50-fa9e-418f-bf54-846db5618c65 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "POST /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad/action" status: 200 len: 32 microversion: 2.1 time: 0.350349 Aug 04 21:46:07.452993 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 316/623] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 4 21:46:07 2022] POST /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad/action => generated 32 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:46:07.463816 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-5de0ace0-e7de-4099-9482-c8088bfdb036 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:07.464605 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-5de0ace0-e7de-4099-9482-c8088bfdb036 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:07.471820 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5de0ace0-e7de-4099-9482-c8088bfdb036 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:07.472324 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5de0ace0-e7de-4099-9482-c8088bfdb036 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:07.472753 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5de0ace0-e7de-4099-9482-c8088bfdb036 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:07.473445 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5de0ace0-e7de-4099-9482-c8088bfdb036 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:07.473895 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5de0ace0-e7de-4099-9482-c8088bfdb036 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:07.474347 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5de0ace0-e7de-4099-9482-c8088bfdb036 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:07.612825 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5de0ace0-e7de-4099-9482-c8088bfdb036 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:07.620692 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-5de0ace0-e7de-4099-9482-c8088bfdb036 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1737 microversion: 2.1 time: 0.161612 Aug 04 21:46:07.621697 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 308/624] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:07 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:08.644260 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2528befb-ac07-4855-b61e-f5abe55f997e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:08.720000 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2528befb-ac07-4855-b61e-f5abe55f997e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:08.720000 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2528befb-ac07-4855-b61e-f5abe55f997e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:08.720000 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2528befb-ac07-4855-b61e-f5abe55f997e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:08.720000 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2528befb-ac07-4855-b61e-f5abe55f997e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:08.720455 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2528befb-ac07-4855-b61e-f5abe55f997e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:08.720455 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2528befb-ac07-4855-b61e-f5abe55f997e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:08.720455 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2528befb-ac07-4855-b61e-f5abe55f997e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:08.801178 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2528befb-ac07-4855-b61e-f5abe55f997e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:08.809399 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2528befb-ac07-4855-b61e-f5abe55f997e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1737 microversion: 2.1 time: 0.170609 Aug 04 21:46:08.810219 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 317/625] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:08 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:08.851892 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c7d77d01-abca-4e41-8fdb-64d6dd627206 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:08.852433 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c7d77d01-abca-4e41-8fdb-64d6dd627206 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:08.858660 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c7d77d01-abca-4e41-8fdb-64d6dd627206 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:08.859137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c7d77d01-abca-4e41-8fdb-64d6dd627206 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:08.859587 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c7d77d01-abca-4e41-8fdb-64d6dd627206 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:08.860264 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c7d77d01-abca-4e41-8fdb-64d6dd627206 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:08.860703 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c7d77d01-abca-4e41-8fdb-64d6dd627206 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:08.861117 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c7d77d01-abca-4e41-8fdb-64d6dd627206 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:08.985510 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.objects.instance [None req-c7d77d01-abca-4e41-8fdb-64d6dd627206 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lazy-loading 'services' on Instance uuid dbeea630-d67b-4f89-a329-c7066d506126 {{(pid=136341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:46:09.254636 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c7d77d01-abca-4e41-8fdb-64d6dd627206 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "DELETE /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126/os-volume_attachments/75959f3f-e96f-4449-8f85-c929d6100585" status: 202 len: 0 microversion: 2.1 time: 0.521734 Aug 04 21:46:09.255435 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 309/626] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 4 21:46:08 2022] DELETE /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126/os-volume_attachments/75959f3f-e96f-4449-8f85-c929d6100585 => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 21:46:09.830736 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-459c2eb5-bbd9-4c4d-9863-34d475e94a04 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:09.831339 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-459c2eb5-bbd9-4c4d-9863-34d475e94a04 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:09.837730 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-459c2eb5-bbd9-4c4d-9863-34d475e94a04 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:09.838251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-459c2eb5-bbd9-4c4d-9863-34d475e94a04 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:09.838684 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-459c2eb5-bbd9-4c4d-9863-34d475e94a04 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:09.839367 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-459c2eb5-bbd9-4c4d-9863-34d475e94a04 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:09.839818 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-459c2eb5-bbd9-4c4d-9863-34d475e94a04 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:09.840239 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-459c2eb5-bbd9-4c4d-9863-34d475e94a04 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:09.967300 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-459c2eb5-bbd9-4c4d-9863-34d475e94a04 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:09.975856 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-459c2eb5-bbd9-4c4d-9863-34d475e94a04 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1737 microversion: 2.1 time: 0.149555 Aug 04 21:46:09.976418 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 318/627] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:09 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:10.998466 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d53b0b65-7b40-44cd-b794-e8bc20017847 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:10.999182 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-d53b0b65-7b40-44cd-b794-e8bc20017847 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:11.006757 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d53b0b65-7b40-44cd-b794-e8bc20017847 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:11.007283 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d53b0b65-7b40-44cd-b794-e8bc20017847 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:11.007755 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d53b0b65-7b40-44cd-b794-e8bc20017847 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:11.008449 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d53b0b65-7b40-44cd-b794-e8bc20017847 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:11.008902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d53b0b65-7b40-44cd-b794-e8bc20017847 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:11.009323 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d53b0b65-7b40-44cd-b794-e8bc20017847 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:11.137472 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d53b0b65-7b40-44cd-b794-e8bc20017847 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:11.146182 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d53b0b65-7b40-44cd-b794-e8bc20017847 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1737 microversion: 2.1 time: 0.152668 Aug 04 21:46:11.146746 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 310/628] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:10 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:11.430842 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a67a5008-4f56-4a1c-85e2-8e33a0517ffc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:46:11.437194 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a67a5008-4f56-4a1c-85e2-8e33a0517ffc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:11.437667 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a67a5008-4f56-4a1c-85e2-8e33a0517ffc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:11.438132 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a67a5008-4f56-4a1c-85e2-8e33a0517ffc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:11.500776 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-a67a5008-4f56-4a1c-85e2-8e33a0517ffc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Going to try to stop instance {{(pid=136342) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 21:46:11.663330 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-a67a5008-4f56-4a1c-85e2-8e33a0517ffc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "POST /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126/action" status: 202 len: 0 microversion: 2.1 time: 0.235981 Aug 04 21:46:11.663873 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 319/629] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 4 21:46:11 2022] POST /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:46:11.671888 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b26130a0-9193-438c-b1fe-80fef092ea25 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:11.672499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b26130a0-9193-438c-b1fe-80fef092ea25 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:11.678652 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b26130a0-9193-438c-b1fe-80fef092ea25 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:11.683809 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b26130a0-9193-438c-b1fe-80fef092ea25 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:11.683809 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b26130a0-9193-438c-b1fe-80fef092ea25 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:11.683809 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b26130a0-9193-438c-b1fe-80fef092ea25 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:11.683809 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b26130a0-9193-438c-b1fe-80fef092ea25 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:11.684170 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b26130a0-9193-438c-b1fe-80fef092ea25 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:11.814171 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b26130a0-9193-438c-b1fe-80fef092ea25 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:11.822659 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b26130a0-9193-438c-b1fe-80fef092ea25 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1675 microversion: 2.1 time: 0.154612 Aug 04 21:46:11.826950 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 311/630] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:11 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:12.166802 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ee69abee-b432-4a9b-810e-d69a007c6973 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:12.167486 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ee69abee-b432-4a9b-810e-d69a007c6973 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:12.173632 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ee69abee-b432-4a9b-810e-d69a007c6973 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:12.174141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ee69abee-b432-4a9b-810e-d69a007c6973 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:12.174572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ee69abee-b432-4a9b-810e-d69a007c6973 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:12.175254 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ee69abee-b432-4a9b-810e-d69a007c6973 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:12.176298 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ee69abee-b432-4a9b-810e-d69a007c6973 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:12.176706 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ee69abee-b432-4a9b-810e-d69a007c6973 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:12.309876 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ee69abee-b432-4a9b-810e-d69a007c6973 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:12.317654 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ee69abee-b432-4a9b-810e-d69a007c6973 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1737 microversion: 2.1 time: 0.155221 Aug 04 21:46:12.318228 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 320/631] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:12 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:12.845971 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-edbe92ee-b245-4ed4-803c-5d40b5bdd8b1 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:12.846536 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-edbe92ee-b245-4ed4-803c-5d40b5bdd8b1 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:12.853007 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-edbe92ee-b245-4ed4-803c-5d40b5bdd8b1 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:12.853479 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-edbe92ee-b245-4ed4-803c-5d40b5bdd8b1 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:12.853904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-edbe92ee-b245-4ed4-803c-5d40b5bdd8b1 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:12.854610 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-edbe92ee-b245-4ed4-803c-5d40b5bdd8b1 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:12.855052 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-edbe92ee-b245-4ed4-803c-5d40b5bdd8b1 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:12.855465 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-edbe92ee-b245-4ed4-803c-5d40b5bdd8b1 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:12.985233 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-edbe92ee-b245-4ed4-803c-5d40b5bdd8b1 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:12.993275 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-edbe92ee-b245-4ed4-803c-5d40b5bdd8b1 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1675 microversion: 2.1 time: 0.151232 Aug 04 21:46:12.993848 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 312/632] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:12 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:13.339002 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-eb407dd2-0238-4ec6-aec1-f9a65c0e8b77 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:13.339500 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-eb407dd2-0238-4ec6-aec1-f9a65c0e8b77 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:13.345808 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eb407dd2-0238-4ec6-aec1-f9a65c0e8b77 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:13.346315 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eb407dd2-0238-4ec6-aec1-f9a65c0e8b77 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:13.346749 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eb407dd2-0238-4ec6-aec1-f9a65c0e8b77 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:13.348320 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eb407dd2-0238-4ec6-aec1-f9a65c0e8b77 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:13.348881 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eb407dd2-0238-4ec6-aec1-f9a65c0e8b77 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:13.349307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-eb407dd2-0238-4ec6-aec1-f9a65c0e8b77 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:13.481397 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-eb407dd2-0238-4ec6-aec1-f9a65c0e8b77 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:13.489398 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-eb407dd2-0238-4ec6-aec1-f9a65c0e8b77 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1737 microversion: 2.1 time: 0.154255 Aug 04 21:46:13.490261 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 321/633] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:13 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:14.014948 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-0d880ea6-c944-4be9-afdc-d7617297fc71 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:14.015548 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-0d880ea6-c944-4be9-afdc-d7617297fc71 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:14.021791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0d880ea6-c944-4be9-afdc-d7617297fc71 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:14.022291 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0d880ea6-c944-4be9-afdc-d7617297fc71 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:14.022718 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0d880ea6-c944-4be9-afdc-d7617297fc71 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:14.023596 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0d880ea6-c944-4be9-afdc-d7617297fc71 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:14.024064 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0d880ea6-c944-4be9-afdc-d7617297fc71 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:14.024476 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0d880ea6-c944-4be9-afdc-d7617297fc71 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:14.152667 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-0d880ea6-c944-4be9-afdc-d7617297fc71 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:14.160055 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-0d880ea6-c944-4be9-afdc-d7617297fc71 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1675 microversion: 2.1 time: 0.148958 Aug 04 21:46:14.160606 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 313/634] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:14 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:14.510923 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-359b084c-7553-4cf7-a14d-329917e3d922 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:14.511520 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-359b084c-7553-4cf7-a14d-329917e3d922 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:14.517923 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-359b084c-7553-4cf7-a14d-329917e3d922 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:14.518582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-359b084c-7553-4cf7-a14d-329917e3d922 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:14.519012 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-359b084c-7553-4cf7-a14d-329917e3d922 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:14.519693 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-359b084c-7553-4cf7-a14d-329917e3d922 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:14.520133 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-359b084c-7553-4cf7-a14d-329917e3d922 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:14.520546 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-359b084c-7553-4cf7-a14d-329917e3d922 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:14.647303 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-359b084c-7553-4cf7-a14d-329917e3d922 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:14.655886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-359b084c-7553-4cf7-a14d-329917e3d922 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1737 microversion: 2.1 time: 0.149803 Aug 04 21:46:14.656446 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 322/635] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:14 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:46:15.181175 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-738138aa-16db-47dd-8083-59938bb4ae8a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:15.181803 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-738138aa-16db-47dd-8083-59938bb4ae8a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:15.188235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-738138aa-16db-47dd-8083-59938bb4ae8a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:15.188714 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-738138aa-16db-47dd-8083-59938bb4ae8a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:15.189143 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-738138aa-16db-47dd-8083-59938bb4ae8a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:15.189825 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-738138aa-16db-47dd-8083-59938bb4ae8a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:15.190304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-738138aa-16db-47dd-8083-59938bb4ae8a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:15.190727 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-738138aa-16db-47dd-8083-59938bb4ae8a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:15.317403 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-738138aa-16db-47dd-8083-59938bb4ae8a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:15.325490 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-738138aa-16db-47dd-8083-59938bb4ae8a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1675 microversion: 2.1 time: 0.148165 Aug 04 21:46:15.326071 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 314/636] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:15 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:15.676739 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-80ea4d18-1b0d-4d66-923c-153298aba9b1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:15.677348 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-80ea4d18-1b0d-4d66-923c-153298aba9b1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:15.684331 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-80ea4d18-1b0d-4d66-923c-153298aba9b1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:15.684803 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-80ea4d18-1b0d-4d66-923c-153298aba9b1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:15.685232 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-80ea4d18-1b0d-4d66-923c-153298aba9b1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:15.685914 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-80ea4d18-1b0d-4d66-923c-153298aba9b1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:15.686389 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-80ea4d18-1b0d-4d66-923c-153298aba9b1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:15.686806 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-80ea4d18-1b0d-4d66-923c-153298aba9b1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:15.818657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-80ea4d18-1b0d-4d66-923c-153298aba9b1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:15.827362 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-80ea4d18-1b0d-4d66-923c-153298aba9b1 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1737 microversion: 2.1 time: 0.154419 Aug 04 21:46:15.827924 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 323/637] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:15 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:16.347149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-35e6ba3f-ed98-4a5d-9d28-7ccf7022544d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:16.354179 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-35e6ba3f-ed98-4a5d-9d28-7ccf7022544d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:16.354907 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-35e6ba3f-ed98-4a5d-9d28-7ccf7022544d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:16.355387 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-35e6ba3f-ed98-4a5d-9d28-7ccf7022544d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:16.355811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-35e6ba3f-ed98-4a5d-9d28-7ccf7022544d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:16.356479 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-35e6ba3f-ed98-4a5d-9d28-7ccf7022544d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:16.356921 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-35e6ba3f-ed98-4a5d-9d28-7ccf7022544d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:16.357331 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-35e6ba3f-ed98-4a5d-9d28-7ccf7022544d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:16.488838 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-35e6ba3f-ed98-4a5d-9d28-7ccf7022544d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:16.497661 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-35e6ba3f-ed98-4a5d-9d28-7ccf7022544d tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1675 microversion: 2.1 time: 0.154310 Aug 04 21:46:16.498278 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 315/638] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:16 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:16.848143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-73cbefda-3794-4192-a1cd-13da175b23c8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:16.848758 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-73cbefda-3794-4192-a1cd-13da175b23c8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:16.855401 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-73cbefda-3794-4192-a1cd-13da175b23c8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:16.855882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-73cbefda-3794-4192-a1cd-13da175b23c8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:16.856315 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-73cbefda-3794-4192-a1cd-13da175b23c8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:16.856999 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-73cbefda-3794-4192-a1cd-13da175b23c8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:16.857448 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-73cbefda-3794-4192-a1cd-13da175b23c8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:16.857866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-73cbefda-3794-4192-a1cd-13da175b23c8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:16.986898 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-73cbefda-3794-4192-a1cd-13da175b23c8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:16.995142 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-73cbefda-3794-4192-a1cd-13da175b23c8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1737 microversion: 2.1 time: 0.150817 Aug 04 21:46:16.995699 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 324/639] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:16 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:17.518753 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-cff9e89e-d94d-4254-9275-71a4205a45af tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:17.519356 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-cff9e89e-d94d-4254-9275-71a4205a45af tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:17.525917 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cff9e89e-d94d-4254-9275-71a4205a45af tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:17.526421 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cff9e89e-d94d-4254-9275-71a4205a45af tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:17.526849 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cff9e89e-d94d-4254-9275-71a4205a45af tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:17.527530 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cff9e89e-d94d-4254-9275-71a4205a45af tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:17.527975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cff9e89e-d94d-4254-9275-71a4205a45af tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:17.528388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cff9e89e-d94d-4254-9275-71a4205a45af tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:17.656380 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-cff9e89e-d94d-4254-9275-71a4205a45af tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:17.663711 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-cff9e89e-d94d-4254-9275-71a4205a45af tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1675 microversion: 2.1 time: 0.148782 Aug 04 21:46:17.664863 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 316/640] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:17 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:18.016787 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-dc0d7d1e-64ed-4afe-b2f7-71cfc851f6ab tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:18.017405 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-dc0d7d1e-64ed-4afe-b2f7-71cfc851f6ab tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:18.025314 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dc0d7d1e-64ed-4afe-b2f7-71cfc851f6ab tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:18.032939 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dc0d7d1e-64ed-4afe-b2f7-71cfc851f6ab tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:18.032939 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dc0d7d1e-64ed-4afe-b2f7-71cfc851f6ab tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:18.032939 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dc0d7d1e-64ed-4afe-b2f7-71cfc851f6ab tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:18.032939 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dc0d7d1e-64ed-4afe-b2f7-71cfc851f6ab tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:18.033400 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dc0d7d1e-64ed-4afe-b2f7-71cfc851f6ab tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:18.162230 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-dc0d7d1e-64ed-4afe-b2f7-71cfc851f6ab tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:18.170293 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-dc0d7d1e-64ed-4afe-b2f7-71cfc851f6ab tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1737 microversion: 2.1 time: 0.157321 Aug 04 21:46:18.170792 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 325/641] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:18 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:18.685096 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-fb05eb4d-afb3-4bb4-9004-8f59a262686b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:18.685699 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-fb05eb4d-afb3-4bb4-9004-8f59a262686b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:18.692015 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fb05eb4d-afb3-4bb4-9004-8f59a262686b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:18.692488 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fb05eb4d-afb3-4bb4-9004-8f59a262686b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:18.692911 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fb05eb4d-afb3-4bb4-9004-8f59a262686b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:18.693598 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fb05eb4d-afb3-4bb4-9004-8f59a262686b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:18.694056 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fb05eb4d-afb3-4bb4-9004-8f59a262686b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:18.694474 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fb05eb4d-afb3-4bb4-9004-8f59a262686b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:18.819758 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-fb05eb4d-afb3-4bb4-9004-8f59a262686b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:18.827811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-fb05eb4d-afb3-4bb4-9004-8f59a262686b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1675 microversion: 2.1 time: 0.146529 Aug 04 21:46:18.828375 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 317/642] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:18 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:19.191337 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-1b77f677-83b8-438f-a8ef-c4c355f716c9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:19.191923 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-1b77f677-83b8-438f-a8ef-c4c355f716c9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:19.198517 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1b77f677-83b8-438f-a8ef-c4c355f716c9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:19.199002 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1b77f677-83b8-438f-a8ef-c4c355f716c9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:19.199439 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1b77f677-83b8-438f-a8ef-c4c355f716c9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:19.200129 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1b77f677-83b8-438f-a8ef-c4c355f716c9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:19.200581 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1b77f677-83b8-438f-a8ef-c4c355f716c9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:19.201005 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1b77f677-83b8-438f-a8ef-c4c355f716c9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:19.327788 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1b77f677-83b8-438f-a8ef-c4c355f716c9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:19.335638 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-1b77f677-83b8-438f-a8ef-c4c355f716c9 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1737 microversion: 2.1 time: 0.148232 Aug 04 21:46:19.336931 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 326/643] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:19 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:19.848426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-7ec263df-e647-4026-91da-78c65104d845 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:19.848941 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-7ec263df-e647-4026-91da-78c65104d845 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:19.855557 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7ec263df-e647-4026-91da-78c65104d845 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:19.856034 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7ec263df-e647-4026-91da-78c65104d845 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:19.856461 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7ec263df-e647-4026-91da-78c65104d845 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:19.857146 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7ec263df-e647-4026-91da-78c65104d845 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:19.857592 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7ec263df-e647-4026-91da-78c65104d845 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:19.858026 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7ec263df-e647-4026-91da-78c65104d845 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:19.993201 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-7ec263df-e647-4026-91da-78c65104d845 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:20.000904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-7ec263df-e647-4026-91da-78c65104d845 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1675 microversion: 2.1 time: 0.156406 Aug 04 21:46:20.001469 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 318/644] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:19 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:20.357451 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a44ec143-7e02-46be-87d4-dd3948a7a24b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:20.358041 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-a44ec143-7e02-46be-87d4-dd3948a7a24b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:20.364324 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a44ec143-7e02-46be-87d4-dd3948a7a24b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:20.364796 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a44ec143-7e02-46be-87d4-dd3948a7a24b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:20.365368 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a44ec143-7e02-46be-87d4-dd3948a7a24b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:20.366070 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a44ec143-7e02-46be-87d4-dd3948a7a24b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:20.366517 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a44ec143-7e02-46be-87d4-dd3948a7a24b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:20.366931 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a44ec143-7e02-46be-87d4-dd3948a7a24b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:20.495031 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-a44ec143-7e02-46be-87d4-dd3948a7a24b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:20.503074 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-a44ec143-7e02-46be-87d4-dd3948a7a24b tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1737 microversion: 2.1 time: 0.149548 Aug 04 21:46:20.503628 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 327/645] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:20 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:21.021399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ae799a9a-60cb-4645-bfe0-9e230ea0f335 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:21.021933 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ae799a9a-60cb-4645-bfe0-9e230ea0f335 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:21.029021 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ae799a9a-60cb-4645-bfe0-9e230ea0f335 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:21.029505 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ae799a9a-60cb-4645-bfe0-9e230ea0f335 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:21.029942 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ae799a9a-60cb-4645-bfe0-9e230ea0f335 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:21.030726 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ae799a9a-60cb-4645-bfe0-9e230ea0f335 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:21.031175 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ae799a9a-60cb-4645-bfe0-9e230ea0f335 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:21.031596 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ae799a9a-60cb-4645-bfe0-9e230ea0f335 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:21.163315 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ae799a9a-60cb-4645-bfe0-9e230ea0f335 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:21.170815 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ae799a9a-60cb-4645-bfe0-9e230ea0f335 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1675 microversion: 2.1 time: 0.153401 Aug 04 21:46:21.171374 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 319/646] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:21 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:21.523854 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a07dd010-f184-421c-a33f-13581af47127 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:21.524547 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-a07dd010-f184-421c-a33f-13581af47127 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:21.531503 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a07dd010-f184-421c-a33f-13581af47127 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:21.531976 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a07dd010-f184-421c-a33f-13581af47127 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:21.532402 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a07dd010-f184-421c-a33f-13581af47127 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:21.533090 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a07dd010-f184-421c-a33f-13581af47127 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:21.533655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a07dd010-f184-421c-a33f-13581af47127 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:21.534143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a07dd010-f184-421c-a33f-13581af47127 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:21.665713 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-a07dd010-f184-421c-a33f-13581af47127 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:21.673608 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-a07dd010-f184-421c-a33f-13581af47127 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1737 microversion: 2.1 time: 0.153733 Aug 04 21:46:21.674253 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 328/647] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:21 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:22.191701 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-aa1ddff4-f5bb-4b79-accb-7054b99399ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:22.192308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-aa1ddff4-f5bb-4b79-accb-7054b99399ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:22.198976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aa1ddff4-f5bb-4b79-accb-7054b99399ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:22.199484 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aa1ddff4-f5bb-4b79-accb-7054b99399ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:22.199915 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aa1ddff4-f5bb-4b79-accb-7054b99399ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:22.200597 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aa1ddff4-f5bb-4b79-accb-7054b99399ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:22.201042 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aa1ddff4-f5bb-4b79-accb-7054b99399ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:22.201453 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aa1ddff4-f5bb-4b79-accb-7054b99399ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:22.334567 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-aa1ddff4-f5bb-4b79-accb-7054b99399ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:22.343163 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-aa1ddff4-f5bb-4b79-accb-7054b99399ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1675 microversion: 2.1 time: 0.155356 Aug 04 21:46:22.343729 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 320/648] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:22 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:22.695601 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4c1f3809-3cdf-4fe1-a0a9-9dc1dc1f1f36 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:22.696337 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4c1f3809-3cdf-4fe1-a0a9-9dc1dc1f1f36 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:22.702618 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c1f3809-3cdf-4fe1-a0a9-9dc1dc1f1f36 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:22.703098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c1f3809-3cdf-4fe1-a0a9-9dc1dc1f1f36 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:22.703524 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c1f3809-3cdf-4fe1-a0a9-9dc1dc1f1f36 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:22.704202 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c1f3809-3cdf-4fe1-a0a9-9dc1dc1f1f36 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:22.704641 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c1f3809-3cdf-4fe1-a0a9-9dc1dc1f1f36 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:22.705049 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c1f3809-3cdf-4fe1-a0a9-9dc1dc1f1f36 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:22.723186 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:46:22.835836 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4c1f3809-3cdf-4fe1-a0a9-9dc1dc1f1f36 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:22.845544 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4c1f3809-3cdf-4fe1-a0a9-9dc1dc1f1f36 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1737 microversion: 2.1 time: 0.153972 Aug 04 21:46:22.846121 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 329/649] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:22 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:23.364635 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c508657f-aeae-4fd1-bb4c-625a87ded076 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:23.365234 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c508657f-aeae-4fd1-bb4c-625a87ded076 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:23.372758 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c508657f-aeae-4fd1-bb4c-625a87ded076 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:23.373232 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c508657f-aeae-4fd1-bb4c-625a87ded076 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:23.373660 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c508657f-aeae-4fd1-bb4c-625a87ded076 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:23.374365 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c508657f-aeae-4fd1-bb4c-625a87ded076 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:23.374808 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c508657f-aeae-4fd1-bb4c-625a87ded076 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:23.375225 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c508657f-aeae-4fd1-bb4c-625a87ded076 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:23.392844 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:46:23.505845 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-c508657f-aeae-4fd1-bb4c-625a87ded076 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:23.515991 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c508657f-aeae-4fd1-bb4c-625a87ded076 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1675 microversion: 2.1 time: 0.155003 Aug 04 21:46:23.516726 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 321/650] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:23 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:23.866442 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8b58bcb4-a66a-465f-b946-834d9ff7584d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:23.867042 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8b58bcb4-a66a-465f-b946-834d9ff7584d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:23.873809 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8b58bcb4-a66a-465f-b946-834d9ff7584d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:23.874318 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8b58bcb4-a66a-465f-b946-834d9ff7584d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:23.874747 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8b58bcb4-a66a-465f-b946-834d9ff7584d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:23.875427 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8b58bcb4-a66a-465f-b946-834d9ff7584d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:23.875873 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8b58bcb4-a66a-465f-b946-834d9ff7584d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:23.876289 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8b58bcb4-a66a-465f-b946-834d9ff7584d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:24.009485 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8b58bcb4-a66a-465f-b946-834d9ff7584d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:24.017291 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8b58bcb4-a66a-465f-b946-834d9ff7584d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1737 microversion: 2.1 time: 0.154738 Aug 04 21:46:24.017840 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 330/651] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:23 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:46:24.537240 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-107c9ddc-c7c5-468b-b666-97cb8d4e548b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:24.537929 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-107c9ddc-c7c5-468b-b666-97cb8d4e548b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:24.544853 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-107c9ddc-c7c5-468b-b666-97cb8d4e548b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:24.545330 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-107c9ddc-c7c5-468b-b666-97cb8d4e548b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:24.545758 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-107c9ddc-c7c5-468b-b666-97cb8d4e548b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:24.546467 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-107c9ddc-c7c5-468b-b666-97cb8d4e548b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:24.546911 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-107c9ddc-c7c5-468b-b666-97cb8d4e548b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:24.547326 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-107c9ddc-c7c5-468b-b666-97cb8d4e548b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:24.672919 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-107c9ddc-c7c5-468b-b666-97cb8d4e548b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:24.680847 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-107c9ddc-c7c5-468b-b666-97cb8d4e548b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1675 microversion: 2.1 time: 0.146942 Aug 04 21:46:24.686912 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 322/652] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:24 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:25.040275 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-27f73cfa-6995-4a42-91a3-558733e4c320 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:25.040858 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-27f73cfa-6995-4a42-91a3-558733e4c320 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:25.047394 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-27f73cfa-6995-4a42-91a3-558733e4c320 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:25.047874 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-27f73cfa-6995-4a42-91a3-558733e4c320 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:25.048305 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-27f73cfa-6995-4a42-91a3-558733e4c320 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:25.048989 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-27f73cfa-6995-4a42-91a3-558733e4c320 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:25.049435 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-27f73cfa-6995-4a42-91a3-558733e4c320 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:25.049854 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-27f73cfa-6995-4a42-91a3-558733e4c320 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:25.177065 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-27f73cfa-6995-4a42-91a3-558733e4c320 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:25.185629 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-27f73cfa-6995-4a42-91a3-558733e4c320 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1737 microversion: 2.1 time: 0.149933 Aug 04 21:46:25.186214 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 331/653] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:25 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:25.706933 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-0b707928-79e6-413c-a052-4ce59b4ba656 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:25.707538 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-0b707928-79e6-413c-a052-4ce59b4ba656 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:25.713810 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0b707928-79e6-413c-a052-4ce59b4ba656 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:25.714431 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0b707928-79e6-413c-a052-4ce59b4ba656 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:25.714891 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0b707928-79e6-413c-a052-4ce59b4ba656 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:25.715579 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0b707928-79e6-413c-a052-4ce59b4ba656 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:25.716038 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0b707928-79e6-413c-a052-4ce59b4ba656 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:25.716458 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0b707928-79e6-413c-a052-4ce59b4ba656 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:25.846417 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-0b707928-79e6-413c-a052-4ce59b4ba656 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:25.854267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-0b707928-79e6-413c-a052-4ce59b4ba656 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1675 microversion: 2.1 time: 0.151199 Aug 04 21:46:25.854818 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 323/654] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:25 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:26.206727 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2144f832-467e-4432-acb8-006bc706aa11 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:26.207325 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2144f832-467e-4432-acb8-006bc706aa11 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:26.213838 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2144f832-467e-4432-acb8-006bc706aa11 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:26.214382 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2144f832-467e-4432-acb8-006bc706aa11 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:26.214845 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2144f832-467e-4432-acb8-006bc706aa11 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:26.215532 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2144f832-467e-4432-acb8-006bc706aa11 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:26.215982 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2144f832-467e-4432-acb8-006bc706aa11 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:26.216433 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2144f832-467e-4432-acb8-006bc706aa11 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:26.347613 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2144f832-467e-4432-acb8-006bc706aa11 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:26.356041 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2144f832-467e-4432-acb8-006bc706aa11 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1737 microversion: 2.1 time: 0.153195 Aug 04 21:46:26.365572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 332/655] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:26 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:26.876471 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-5605279c-ad52-48ff-8d65-02ee0ae36dfc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:26.877115 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-5605279c-ad52-48ff-8d65-02ee0ae36dfc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:26.883397 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5605279c-ad52-48ff-8d65-02ee0ae36dfc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:26.883880 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5605279c-ad52-48ff-8d65-02ee0ae36dfc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:26.884312 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5605279c-ad52-48ff-8d65-02ee0ae36dfc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:26.885811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5605279c-ad52-48ff-8d65-02ee0ae36dfc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:26.886297 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5605279c-ad52-48ff-8d65-02ee0ae36dfc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:26.886721 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5605279c-ad52-48ff-8d65-02ee0ae36dfc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:27.040312 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5605279c-ad52-48ff-8d65-02ee0ae36dfc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:27.048832 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-5605279c-ad52-48ff-8d65-02ee0ae36dfc tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1675 microversion: 2.1 time: 0.176360 Aug 04 21:46:27.049390 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 324/656] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:26 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:27.385505 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e0b0aa18-da8d-4251-9d03-eacca5e6dbb6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:27.386141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e0b0aa18-da8d-4251-9d03-eacca5e6dbb6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:27.392528 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e0b0aa18-da8d-4251-9d03-eacca5e6dbb6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:27.393008 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e0b0aa18-da8d-4251-9d03-eacca5e6dbb6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:27.393441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e0b0aa18-da8d-4251-9d03-eacca5e6dbb6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:27.394169 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e0b0aa18-da8d-4251-9d03-eacca5e6dbb6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:27.394616 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e0b0aa18-da8d-4251-9d03-eacca5e6dbb6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:27.395037 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e0b0aa18-da8d-4251-9d03-eacca5e6dbb6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:27.527772 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e0b0aa18-da8d-4251-9d03-eacca5e6dbb6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:27.535181 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e0b0aa18-da8d-4251-9d03-eacca5e6dbb6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1717 microversion: 2.1 time: 0.153709 Aug 04 21:46:27.535736 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 333/657] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:27 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:27.599759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-bd3e7a5e-b20e-442f-b1b1-7258246952d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:27.600308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-bd3e7a5e-b20e-442f-b1b1-7258246952d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:27.602405 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=37 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:46:27.607863 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bd3e7a5e-b20e-442f-b1b1-7258246952d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:27.610757 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bd3e7a5e-b20e-442f-b1b1-7258246952d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:27.610757 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bd3e7a5e-b20e-442f-b1b1-7258246952d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:27.610757 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bd3e7a5e-b20e-442f-b1b1-7258246952d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:27.610757 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bd3e7a5e-b20e-442f-b1b1-7258246952d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:27.611189 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bd3e7a5e-b20e-442f-b1b1-7258246952d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:27.694395 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-bd3e7a5e-b20e-442f-b1b1-7258246952d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] HTTP exception thrown: Cannot 'detach_volume' instance c72a9092-7229-4677-9e8c-1849b5f3aaad while it is in vm_state rescued Aug 04 21:46:27.696028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-bd3e7a5e-b20e-442f-b1b1-7258246952d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Request method failure captured: Aug 04 21:46:27.696028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: DELETE /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad/os-volume_attachments/153efaff-2cf0-4272-8ab7-6ac4024ff7f5 HTTP/1.1 Aug 04 21:46:27.696028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:46:27.696028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:46:27.696028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:46:27.696028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 21:46:27.696028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:46:27.696028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:46:27.696028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:46:27.696028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:46:27.696028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7DzPr3cM533Uh9AlWXMHAOzqV7gXVwqd--0bCgLVckarAi2mkz1ojxMjcGyrQ_e6XAF05QDwl9mDP-ttkz96Zi6hf_R9XyiWCakQo1K49Ma92db_R5HUTLJxm7q8GtOr48qzTBtYaspx9TwpgWzcB1mofFXXnH8mJOATCThNeioonFw Aug 04 21:46:27.696028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:46:27.696028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:46:27.696028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:46:27.696028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:46:27.696028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:46:27.696028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:46:27.696028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: 26fb895147494be98bb6ceb8704984b7 Aug 04 21:46:27.696028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1281602055 Aug 04 21:46:27.696028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:46:27.696028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:46:27.698639 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_26fb895147494be98bb6ceb8704984b7", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/26fb895147494be98bb6ceb8704984b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/26fb895147494be98bb6ceb8704984b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/26fb895147494be98bb6ceb8704984b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:46:27.698639 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1281602055 Aug 04 21:46:27.698639 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: 26fb895147494be98bb6ceb8704984b7 Aug 04 21:46:27.698639 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1281602055 Aug 04 21:46:27.698639 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-ServerRescueNegativeTestJSON-1281602055-project Aug 04 21:46:27.698639 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:46:27.698639 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:46:27.698639 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: d9bc42bec393430b9b3e9399a8c4f95e Aug 04 21:46:27.698639 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1281602055-project Aug 04 21:46:27.698639 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 21:46:27.698639 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Cannot 'detach_volume' instance c72a9092-7229-4677-9e8c-1849b5f3aaad while it is in vm_state rescued Aug 04 21:46:27.699345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'server_id': 'c72a9092-7229-4677-9e8c-1849b5f3aaad', 'id': '153efaff-2cf0-4272-8ab7-6ac4024ff7f5'} Aug 04 21:46:27.699345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:46:27.699345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:46:27.699345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 21:46:27.699345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 21:46:27.699345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 21:46:27.699345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 21:46:27.699345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 21:46:27.699345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 21:46:27.699345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c72a9092-7229-4677-9e8c-1849b5f3aaad in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 04 21:46:27.699345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:46:27.699345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:46:27.699345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:46:27.699345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:46:27.699345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:46:27.699345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:46:27.699345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:46:27.699345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:46:27.699345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:46:27.699345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:46:27.700619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 04 21:46:27.700619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 21:46:27.700619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 21:46:27.700619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 21:46:27.700619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c72a9092-7229-4677-9e8c-1849b5f3aaad while it is in vm_state rescued Aug 04 21:46:27.700619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:46:27.700619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:46:27.700619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:46:27.700619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:46:27.700619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:46:27.700619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:46:27.700619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:46:27.700619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:46:27.700619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c72a9092-7229-4677-9e8c-1849b5f3aaad while it is in vm_state rescued Aug 04 21:46:27.700619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:46:27.700619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-bd3e7a5e-b20e-442f-b1b1-7258246952d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Returning 409 to user: Cannot 'detach_volume' instance c72a9092-7229-4677-9e8c-1849b5f3aaad while it is in vm_state rescued {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:46:27.701684 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-bd3e7a5e-b20e-442f-b1b1-7258246952d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad/os-volume_attachments/153efaff-2cf0-4272-8ab7-6ac4024ff7f5" status: 409 len: 152 microversion: 2.1 time: 0.102152 Aug 04 21:46:27.701684 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 325/658] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 4 21:46:27 2022] DELETE /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad/os-volume_attachments/153efaff-2cf0-4272-8ab7-6ac4024ff7f5 => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 21:46:27.709516 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-5e002ccc-0e72-4951-b9c8-94f06dfcfb87 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:46:27.710076 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-5e002ccc-0e72-4951-b9c8-94f06dfcfb87 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:27.716612 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5e002ccc-0e72-4951-b9c8-94f06dfcfb87 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:27.718639 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5e002ccc-0e72-4951-b9c8-94f06dfcfb87 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:27.718639 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5e002ccc-0e72-4951-b9c8-94f06dfcfb87 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:27.719251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5e002ccc-0e72-4951-b9c8-94f06dfcfb87 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:27.719712 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5e002ccc-0e72-4951-b9c8-94f06dfcfb87 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:27.720130 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5e002ccc-0e72-4951-b9c8-94f06dfcfb87 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:27.913868 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-5e002ccc-0e72-4951-b9c8-94f06dfcfb87 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "POST /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad/action" status: 202 len: 0 microversion: 2.1 time: 0.207940 Aug 04 21:46:27.914790 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 334/659] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 4 21:46:27 2022] POST /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 21:46:27.924481 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a93295ab-55b0-424f-aedb-2b2a0e45448f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:27.925238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a93295ab-55b0-424f-aedb-2b2a0e45448f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:27.933350 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a93295ab-55b0-424f-aedb-2b2a0e45448f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:27.933847 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a93295ab-55b0-424f-aedb-2b2a0e45448f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:27.934314 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a93295ab-55b0-424f-aedb-2b2a0e45448f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:27.935014 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a93295ab-55b0-424f-aedb-2b2a0e45448f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:27.935473 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a93295ab-55b0-424f-aedb-2b2a0e45448f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:27.935901 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a93295ab-55b0-424f-aedb-2b2a0e45448f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:28.074036 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a93295ab-55b0-424f-aedb-2b2a0e45448f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:28.078301 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-dabf7fbe-4f0d-4e88-aa04-c3a0db2ae9bb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:28.080748 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-dabf7fbe-4f0d-4e88-aa04-c3a0db2ae9bb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:28.082554 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a93295ab-55b0-424f-aedb-2b2a0e45448f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1725 microversion: 2.1 time: 0.161940 Aug 04 21:46:28.089070 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 326/660] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:27 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:28.090800 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dabf7fbe-4f0d-4e88-aa04-c3a0db2ae9bb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:28.091634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dabf7fbe-4f0d-4e88-aa04-c3a0db2ae9bb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:28.092154 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dabf7fbe-4f0d-4e88-aa04-c3a0db2ae9bb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:28.092948 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dabf7fbe-4f0d-4e88-aa04-c3a0db2ae9bb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:28.093474 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dabf7fbe-4f0d-4e88-aa04-c3a0db2ae9bb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:28.094158 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-dabf7fbe-4f0d-4e88-aa04-c3a0db2ae9bb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:28.343808 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-dabf7fbe-4f0d-4e88-aa04-c3a0db2ae9bb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:28.351342 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-dabf7fbe-4f0d-4e88-aa04-c3a0db2ae9bb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1675 microversion: 2.1 time: 0.284028 Aug 04 21:46:28.355996 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 335/661] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:28 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1675 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:46:29.105806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-78a040de-9595-463e-bcf6-435ebeb78177 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:29.106445 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-78a040de-9595-463e-bcf6-435ebeb78177 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:29.112909 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-78a040de-9595-463e-bcf6-435ebeb78177 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:29.113391 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-78a040de-9595-463e-bcf6-435ebeb78177 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:29.113825 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-78a040de-9595-463e-bcf6-435ebeb78177 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:29.114563 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-78a040de-9595-463e-bcf6-435ebeb78177 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:29.115019 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-78a040de-9595-463e-bcf6-435ebeb78177 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:29.115470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-78a040de-9595-463e-bcf6-435ebeb78177 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:29.243447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-78a040de-9595-463e-bcf6-435ebeb78177 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:29.251597 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-78a040de-9595-463e-bcf6-435ebeb78177 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1725 microversion: 2.1 time: 0.149872 Aug 04 21:46:29.252158 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 327/662] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:29 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:29.372931 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8e0c1615-3d0b-4982-8c4c-31977744dee7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:29.373532 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8e0c1615-3d0b-4982-8c4c-31977744dee7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:29.380109 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8e0c1615-3d0b-4982-8c4c-31977744dee7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:29.385321 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8e0c1615-3d0b-4982-8c4c-31977744dee7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:29.385321 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8e0c1615-3d0b-4982-8c4c-31977744dee7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:29.385321 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8e0c1615-3d0b-4982-8c4c-31977744dee7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:29.385321 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8e0c1615-3d0b-4982-8c4c-31977744dee7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:29.385855 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8e0c1615-3d0b-4982-8c4c-31977744dee7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:29.511556 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8e0c1615-3d0b-4982-8c4c-31977744dee7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:29.519245 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8e0c1615-3d0b-4982-8c4c-31977744dee7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1675 microversion: 2.1 time: 0.150559 Aug 04 21:46:29.519902 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 336/663] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:29 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:46:30.272398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-03b1ced1-e37f-4e4c-ba3d-5f2e9c5d25ca tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:30.273003 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-03b1ced1-e37f-4e4c-ba3d-5f2e9c5d25ca tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:30.279362 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-03b1ced1-e37f-4e4c-ba3d-5f2e9c5d25ca tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:30.279839 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-03b1ced1-e37f-4e4c-ba3d-5f2e9c5d25ca tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:30.280271 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-03b1ced1-e37f-4e4c-ba3d-5f2e9c5d25ca tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:30.280949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-03b1ced1-e37f-4e4c-ba3d-5f2e9c5d25ca tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:30.281397 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-03b1ced1-e37f-4e4c-ba3d-5f2e9c5d25ca tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:30.281816 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-03b1ced1-e37f-4e4c-ba3d-5f2e9c5d25ca tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:30.413558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-03b1ced1-e37f-4e4c-ba3d-5f2e9c5d25ca tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:30.422899 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-03b1ced1-e37f-4e4c-ba3d-5f2e9c5d25ca tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1725 microversion: 2.1 time: 0.154341 Aug 04 21:46:30.423447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 328/664] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:30 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:30.540845 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-31616a9f-b7a5-4cf0-a9be-fa0b6b5d08ef tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:30.542165 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-31616a9f-b7a5-4cf0-a9be-fa0b6b5d08ef tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:30.548515 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-31616a9f-b7a5-4cf0-a9be-fa0b6b5d08ef tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:30.548987 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-31616a9f-b7a5-4cf0-a9be-fa0b6b5d08ef tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:30.549410 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-31616a9f-b7a5-4cf0-a9be-fa0b6b5d08ef tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:30.550117 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-31616a9f-b7a5-4cf0-a9be-fa0b6b5d08ef tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:30.550562 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-31616a9f-b7a5-4cf0-a9be-fa0b6b5d08ef tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:30.550978 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-31616a9f-b7a5-4cf0-a9be-fa0b6b5d08ef tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:30.684265 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-31616a9f-b7a5-4cf0-a9be-fa0b6b5d08ef tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:30.691563 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-31616a9f-b7a5-4cf0-a9be-fa0b6b5d08ef tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1675 microversion: 2.1 time: 0.154649 Aug 04 21:46:30.692117 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 337/665] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:30 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:31.443390 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-dec45be3-3c38-4da2-b567-973e22f0c695 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:31.443981 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-dec45be3-3c38-4da2-b567-973e22f0c695 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:31.450577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dec45be3-3c38-4da2-b567-973e22f0c695 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:31.451052 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dec45be3-3c38-4da2-b567-973e22f0c695 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:31.451477 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dec45be3-3c38-4da2-b567-973e22f0c695 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:31.452152 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dec45be3-3c38-4da2-b567-973e22f0c695 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:31.452595 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dec45be3-3c38-4da2-b567-973e22f0c695 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:31.453008 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dec45be3-3c38-4da2-b567-973e22f0c695 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:31.592375 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-dec45be3-3c38-4da2-b567-973e22f0c695 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:31.602836 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-dec45be3-3c38-4da2-b567-973e22f0c695 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1725 microversion: 2.1 time: 0.163269 Aug 04 21:46:31.604142 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 329/666] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:31 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:31.713878 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d52e5aa4-492e-4e6d-884b-3af8fb98e80e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:31.714526 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d52e5aa4-492e-4e6d-884b-3af8fb98e80e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:31.721292 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d52e5aa4-492e-4e6d-884b-3af8fb98e80e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:31.721775 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d52e5aa4-492e-4e6d-884b-3af8fb98e80e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:31.722227 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d52e5aa4-492e-4e6d-884b-3af8fb98e80e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:31.722926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d52e5aa4-492e-4e6d-884b-3af8fb98e80e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:31.723367 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d52e5aa4-492e-4e6d-884b-3af8fb98e80e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:31.723902 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d52e5aa4-492e-4e6d-884b-3af8fb98e80e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:31.856728 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d52e5aa4-492e-4e6d-884b-3af8fb98e80e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:31.861486 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d52e5aa4-492e-4e6d-884b-3af8fb98e80e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1675 microversion: 2.1 time: 0.152087 Aug 04 21:46:31.862066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 338/667] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:31 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:32.625156 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-33b28aa7-6560-4188-8934-04f3176af6c4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:32.625763 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-33b28aa7-6560-4188-8934-04f3176af6c4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:32.632143 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-33b28aa7-6560-4188-8934-04f3176af6c4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:32.632618 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-33b28aa7-6560-4188-8934-04f3176af6c4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:32.633046 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-33b28aa7-6560-4188-8934-04f3176af6c4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:32.633720 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-33b28aa7-6560-4188-8934-04f3176af6c4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:32.634197 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-33b28aa7-6560-4188-8934-04f3176af6c4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:32.634615 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-33b28aa7-6560-4188-8934-04f3176af6c4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:32.760484 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-33b28aa7-6560-4188-8934-04f3176af6c4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:32.768581 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-33b28aa7-6560-4188-8934-04f3176af6c4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1731 microversion: 2.1 time: 0.147679 Aug 04 21:46:32.769144 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 330/668] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:32 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:32.789222 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-1718f0ff-7f33-4813-bc0a-84995f741303 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:32.789732 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-1718f0ff-7f33-4813-bc0a-84995f741303 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:32.796827 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1718f0ff-7f33-4813-bc0a-84995f741303 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:32.797288 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1718f0ff-7f33-4813-bc0a-84995f741303 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:32.797713 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1718f0ff-7f33-4813-bc0a-84995f741303 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:32.798466 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1718f0ff-7f33-4813-bc0a-84995f741303 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:32.798912 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1718f0ff-7f33-4813-bc0a-84995f741303 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:32.799330 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1718f0ff-7f33-4813-bc0a-84995f741303 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:32.879645 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-1718f0ff-7f33-4813-bc0a-84995f741303 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094236 Aug 04 21:46:32.880228 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 339/669] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 4 21:46:32 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:46:32.884013 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-16e9ba93-e5dd-40dc-8274-310a516b8d15 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:32.884648 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-16e9ba93-e5dd-40dc-8274-310a516b8d15 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:32.890755 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-16e9ba93-e5dd-40dc-8274-310a516b8d15 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:32.891240 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-16e9ba93-e5dd-40dc-8274-310a516b8d15 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:32.891726 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-16e9ba93-e5dd-40dc-8274-310a516b8d15 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:32.892337 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-16e9ba93-e5dd-40dc-8274-310a516b8d15 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:32.892788 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-16e9ba93-e5dd-40dc-8274-310a516b8d15 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:32.893227 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-16e9ba93-e5dd-40dc-8274-310a516b8d15 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:33.028633 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-16e9ba93-e5dd-40dc-8274-310a516b8d15 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:33.036476 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-16e9ba93-e5dd-40dc-8274-310a516b8d15 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1652 microversion: 2.1 time: 0.156204 Aug 04 21:46:33.037030 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 331/670] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:32 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1652 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:46:33.062793 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-41e666e3-a2c0-469f-8281-4a4e0e5d1c1b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:46:33.064148 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-41e666e3-a2c0-469f-8281-4a4e0e5d1c1b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:33.064630 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-41e666e3-a2c0-469f-8281-4a4e0e5d1c1b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:33.065059 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-41e666e3-a2c0-469f-8281-4a4e0e5d1c1b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:33.086592 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-41e666e3-a2c0-469f-8281-4a4e0e5d1c1b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Going to try to start instance {{(pid=136342) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 21:46:33.297646 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-41e666e3-a2c0-469f-8281-4a4e0e5d1c1b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "POST /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126/action" status: 202 len: 0 microversion: 2.1 time: 0.244024 Aug 04 21:46:33.298457 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 340/671] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 4 21:46:33 2022] POST /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:46:33.314982 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-423eb5f7-aeaa-4ad1-becd-9488a4b13da8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:33.315855 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-423eb5f7-aeaa-4ad1-becd-9488a4b13da8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:33.321796 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-423eb5f7-aeaa-4ad1-becd-9488a4b13da8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:33.323504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-423eb5f7-aeaa-4ad1-becd-9488a4b13da8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:33.323504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-423eb5f7-aeaa-4ad1-becd-9488a4b13da8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:33.323739 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-423eb5f7-aeaa-4ad1-becd-9488a4b13da8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:33.324084 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-423eb5f7-aeaa-4ad1-becd-9488a4b13da8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:33.324499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-423eb5f7-aeaa-4ad1-becd-9488a4b13da8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:33.464269 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-423eb5f7-aeaa-4ad1-becd-9488a4b13da8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:33.476403 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-423eb5f7-aeaa-4ad1-becd-9488a4b13da8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1661 microversion: 2.1 time: 0.165407 Aug 04 21:46:33.476977 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 332/672] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:33 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1661 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:34.384403 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-ebbbe291-f654-4f37-92b1-a6ac607ccc95 req-f727be58-51cb-4bb1-ad2d-819bed03ede2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c72a9092-7229-4677-9e8c-1849b5f3aaad", "tag": "0489e5c1-ed3b-4c8c-a0e2-848dabad5165"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:46:34.396305 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-ebbbe291-f654-4f37-92b1-a6ac607ccc95 req-f727be58-51cb-4bb1-ad2d-819bed03ede2 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:34.396781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-ebbbe291-f654-4f37-92b1-a6ac607ccc95 req-f727be58-51cb-4bb1-ad2d-819bed03ede2 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:34.397210 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-ebbbe291-f654-4f37-92b1-a6ac607ccc95 req-f727be58-51cb-4bb1-ad2d-819bed03ede2 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:34.410795 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-ebbbe291-f654-4f37-92b1-a6ac607ccc95 req-f727be58-51cb-4bb1-ad2d-819bed03ede2 service nova] Creating event network-changed:0489e5c1-ed3b-4c8c-a0e2-848dabad5165 for instance c72a9092-7229-4677-9e8c-1849b5f3aaad on hv-cinder-85220 Aug 04 21:46:34.419788 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-ebbbe291-f654-4f37-92b1-a6ac607ccc95 req-f727be58-51cb-4bb1-ad2d-819bed03ede2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104725 Aug 04 21:46:34.421315 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 341/673] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:46:34.500012 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d9934389-1fb1-428c-b38f-aad2d10d5044 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:34.500625 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-d9934389-1fb1-428c-b38f-aad2d10d5044 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:34.508421 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d9934389-1fb1-428c-b38f-aad2d10d5044 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:34.509267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d9934389-1fb1-428c-b38f-aad2d10d5044 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:34.510885 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d9934389-1fb1-428c-b38f-aad2d10d5044 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:34.512217 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d9934389-1fb1-428c-b38f-aad2d10d5044 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:34.512879 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d9934389-1fb1-428c-b38f-aad2d10d5044 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:34.513500 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d9934389-1fb1-428c-b38f-aad2d10d5044 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:34.653403 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d9934389-1fb1-428c-b38f-aad2d10d5044 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:34.660795 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d9934389-1fb1-428c-b38f-aad2d10d5044 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1661 microversion: 2.1 time: 0.165608 Aug 04 21:46:34.661364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 333/674] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:34 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1661 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:35.683775 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f0974509-2e3e-4eeb-8e12-afae6e8fafc5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:35.684813 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-f0974509-2e3e-4eeb-8e12-afae6e8fafc5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:35.691181 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f0974509-2e3e-4eeb-8e12-afae6e8fafc5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:35.694562 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f0974509-2e3e-4eeb-8e12-afae6e8fafc5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:35.694562 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f0974509-2e3e-4eeb-8e12-afae6e8fafc5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:35.694562 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f0974509-2e3e-4eeb-8e12-afae6e8fafc5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:35.694562 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f0974509-2e3e-4eeb-8e12-afae6e8fafc5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:35.695006 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f0974509-2e3e-4eeb-8e12-afae6e8fafc5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:35.824592 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-f0974509-2e3e-4eeb-8e12-afae6e8fafc5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:35.832019 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-f0974509-2e3e-4eeb-8e12-afae6e8fafc5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1661 microversion: 2.1 time: 0.153681 Aug 04 21:46:35.832568 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 342/675] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:35 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1661 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:36.438189 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-777bc23c-5ef0-451c-b0b5-e8bdb9ea5352 req-49da189f-0291-4fad-96c1-1e1331b318e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c72a9092-7229-4677-9e8c-1849b5f3aaad", "tag": "0489e5c1-ed3b-4c8c-a0e2-848dabad5165"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:46:36.448241 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-777bc23c-5ef0-451c-b0b5-e8bdb9ea5352 req-49da189f-0291-4fad-96c1-1e1331b318e1 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:36.448707 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-777bc23c-5ef0-451c-b0b5-e8bdb9ea5352 req-49da189f-0291-4fad-96c1-1e1331b318e1 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:36.449127 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-777bc23c-5ef0-451c-b0b5-e8bdb9ea5352 req-49da189f-0291-4fad-96c1-1e1331b318e1 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:36.459556 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-777bc23c-5ef0-451c-b0b5-e8bdb9ea5352 req-49da189f-0291-4fad-96c1-1e1331b318e1 service nova] Creating event network-changed:0489e5c1-ed3b-4c8c-a0e2-848dabad5165 for instance c72a9092-7229-4677-9e8c-1849b5f3aaad on hv-cinder-85220 Aug 04 21:46:36.465149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-777bc23c-5ef0-451c-b0b5-e8bdb9ea5352 req-49da189f-0291-4fad-96c1-1e1331b318e1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030668 Aug 04 21:46:36.465780 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 334/676] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:46:36.853100 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d07fed61-6449-4af0-8b62-0ec3d529be55 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:36.853703 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d07fed61-6449-4af0-8b62-0ec3d529be55 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:36.860960 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d07fed61-6449-4af0-8b62-0ec3d529be55 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:36.861442 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d07fed61-6449-4af0-8b62-0ec3d529be55 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:36.861868 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d07fed61-6449-4af0-8b62-0ec3d529be55 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:36.862576 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d07fed61-6449-4af0-8b62-0ec3d529be55 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:36.863022 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d07fed61-6449-4af0-8b62-0ec3d529be55 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:36.863439 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d07fed61-6449-4af0-8b62-0ec3d529be55 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:36.997750 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d07fed61-6449-4af0-8b62-0ec3d529be55 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:37.005510 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d07fed61-6449-4af0-8b62-0ec3d529be55 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1665 microversion: 2.1 time: 0.156311 Aug 04 21:46:37.006110 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 343/677] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:46:36 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:54.237675 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=19 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:46:54.238442 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=76 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:46:54.242617 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b617265c-0020-4312-8f74-998343b52bb6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:54.243218 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b617265c-0020-4312-8f74-998343b52bb6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:54.249349 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b617265c-0020-4312-8f74-998343b52bb6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:54.255726 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b617265c-0020-4312-8f74-998343b52bb6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:54.255726 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b617265c-0020-4312-8f74-998343b52bb6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:54.255726 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b617265c-0020-4312-8f74-998343b52bb6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:54.255726 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b617265c-0020-4312-8f74-998343b52bb6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:54.256128 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b617265c-0020-4312-8f74-998343b52bb6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:54.280451 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b617265c-0020-4312-8f74-998343b52bb6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090/os-volume_attachments/b7353d96-cde2-4cc1-ab99-3794d714b3a5" status: 200 len: 194 microversion: 2.20 time: 0.044513 Aug 04 21:46:54.284607 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 335/678] 10.222.0.73 () {60 vars in 1454 bytes} [Thu Aug 4 21:46:54 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090/os-volume_attachments/b7353d96-cde2-4cc1-ab99-3794d714b3a5 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:46:54.347120 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f0cfa86d-e87a-4384-9a5a-9c941ce094ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:54.347758 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-f0cfa86d-e87a-4384-9a5a-9c941ce094ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:54.349796 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=56 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:46:54.350623 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:46:54.355250 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f0cfa86d-e87a-4384-9a5a-9c941ce094ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:54.358805 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f0cfa86d-e87a-4384-9a5a-9c941ce094ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:54.358805 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f0cfa86d-e87a-4384-9a5a-9c941ce094ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:54.358805 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f0cfa86d-e87a-4384-9a5a-9c941ce094ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:54.358805 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f0cfa86d-e87a-4384-9a5a-9c941ce094ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:54.359148 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f0cfa86d-e87a-4384-9a5a-9c941ce094ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:54.486035 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-f0cfa86d-e87a-4384-9a5a-9c941ce094ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lazy-loading 'services' on Instance uuid 87934a42-5a51-4ba4-81ed-d07b785bc090 {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:46:54.755631 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-f0cfa86d-e87a-4384-9a5a-9c941ce094ea tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "DELETE /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090/os-volume_attachments/b7353d96-cde2-4cc1-ab99-3794d714b3a5" status: 202 len: 0 microversion: 2.20 time: 0.412356 Aug 04 21:46:54.756227 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 344/679] 10.222.0.73 () {60 vars in 1457 bytes} [Thu Aug 4 21:46:54 2022] DELETE /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090/os-volume_attachments/b7353d96-cde2-4cc1-ab99-3794d714b3a5 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:46:54.764697 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a74854ba-abb0-4bb2-8f27-edc807f28f60 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:54.766961 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a74854ba-abb0-4bb2-8f27-edc807f28f60 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:54.774193 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a74854ba-abb0-4bb2-8f27-edc807f28f60 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:54.774660 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a74854ba-abb0-4bb2-8f27-edc807f28f60 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:54.775081 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a74854ba-abb0-4bb2-8f27-edc807f28f60 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:54.775759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a74854ba-abb0-4bb2-8f27-edc807f28f60 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:54.776247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a74854ba-abb0-4bb2-8f27-edc807f28f60 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:54.776649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a74854ba-abb0-4bb2-8f27-edc807f28f60 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:54.805766 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a74854ba-abb0-4bb2-8f27-edc807f28f60 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045078 Aug 04 21:46:54.806338 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 336/680] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 4 21:46:54 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:46:55.818832 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-c1c33e64-fb4e-49ff-a9e6-937144e63066 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:55.821281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-c1c33e64-fb4e-49ff-a9e6-937144e63066 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:55.827922 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c1c33e64-fb4e-49ff-a9e6-937144e63066 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:55.828402 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c1c33e64-fb4e-49ff-a9e6-937144e63066 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:55.828833 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c1c33e64-fb4e-49ff-a9e6-937144e63066 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:55.829513 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c1c33e64-fb4e-49ff-a9e6-937144e63066 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:55.829997 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c1c33e64-fb4e-49ff-a9e6-937144e63066 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:55.830441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c1c33e64-fb4e-49ff-a9e6-937144e63066 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:55.859342 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-c1c33e64-fb4e-49ff-a9e6-937144e63066 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045721 Aug 04 21:46:55.859921 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 345/681] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 4 21:46:55 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:46:56.873008 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-490d9db6-7707-4c1b-84fa-d25abb6423c5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:56.875119 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-490d9db6-7707-4c1b-84fa-d25abb6423c5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:56.882395 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-490d9db6-7707-4c1b-84fa-d25abb6423c5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:56.882872 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-490d9db6-7707-4c1b-84fa-d25abb6423c5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:56.883302 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-490d9db6-7707-4c1b-84fa-d25abb6423c5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:56.883985 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-490d9db6-7707-4c1b-84fa-d25abb6423c5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:56.884430 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-490d9db6-7707-4c1b-84fa-d25abb6423c5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:56.884871 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-490d9db6-7707-4c1b-84fa-d25abb6423c5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:56.912583 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-490d9db6-7707-4c1b-84fa-d25abb6423c5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043967 Aug 04 21:46:56.913125 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 337/682] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 4 21:46:56 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:46:56.973590 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8795db9d-8265-42ff-aa21-d4a381ddbe23 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:56.974114 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8795db9d-8265-42ff-aa21-d4a381ddbe23 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:56.980333 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8795db9d-8265-42ff-aa21-d4a381ddbe23 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:56.985929 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8795db9d-8265-42ff-aa21-d4a381ddbe23 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:56.985929 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8795db9d-8265-42ff-aa21-d4a381ddbe23 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:56.985929 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8795db9d-8265-42ff-aa21-d4a381ddbe23 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:56.985929 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8795db9d-8265-42ff-aa21-d4a381ddbe23 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:56.986508 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8795db9d-8265-42ff-aa21-d4a381ddbe23 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:57.008302 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8795db9d-8265-42ff-aa21-d4a381ddbe23 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Going to try to terminate instance {{(pid=136342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:46:57.390752 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8795db9d-8265-42ff-aa21-d4a381ddbe23 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "DELETE /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 204 len: 0 microversion: 2.20 time: 0.420642 Aug 04 21:46:57.393034 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 346/683] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 4 21:46:56 2022] DELETE /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 21:46:57.399737 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2072ff3e-8a30-4c63-b7f8-a3239a7b0193 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:57.400340 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-2072ff3e-8a30-4c63-b7f8-a3239a7b0193 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:57.406237 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2072ff3e-8a30-4c63-b7f8-a3239a7b0193 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:57.406716 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2072ff3e-8a30-4c63-b7f8-a3239a7b0193 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:57.407147 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2072ff3e-8a30-4c63-b7f8-a3239a7b0193 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:57.407824 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2072ff3e-8a30-4c63-b7f8-a3239a7b0193 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:57.408274 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2072ff3e-8a30-4c63-b7f8-a3239a7b0193 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:57.408691 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2072ff3e-8a30-4c63-b7f8-a3239a7b0193 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:57.538809 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2072ff3e-8a30-4c63-b7f8-a3239a7b0193 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:57.546599 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2072ff3e-8a30-4c63-b7f8-a3239a7b0193 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:57.548075 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2072ff3e-8a30-4c63-b7f8-a3239a7b0193 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:57.549212 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2072ff3e-8a30-4c63-b7f8-a3239a7b0193 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1722 microversion: 2.20 time: 0.153464 Aug 04 21:46:57.549763 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 338/684] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:46:57 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:46:58.574274 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e863491d-6752-4327-be4b-07359cbfae0f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:58.575159 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e863491d-6752-4327-be4b-07359cbfae0f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:58.581635 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e863491d-6752-4327-be4b-07359cbfae0f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:58.582150 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e863491d-6752-4327-be4b-07359cbfae0f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:58.582626 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e863491d-6752-4327-be4b-07359cbfae0f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:58.583396 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e863491d-6752-4327-be4b-07359cbfae0f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:58.583856 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e863491d-6752-4327-be4b-07359cbfae0f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:58.584277 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e863491d-6752-4327-be4b-07359cbfae0f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:58.720221 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e863491d-6752-4327-be4b-07359cbfae0f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:58.728645 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e863491d-6752-4327-be4b-07359cbfae0f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:58.730169 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e863491d-6752-4327-be4b-07359cbfae0f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:58.731308 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e863491d-6752-4327-be4b-07359cbfae0f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1722 microversion: 2.20 time: 0.161505 Aug 04 21:46:58.731867 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 347/685] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:46:58 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:46:59.755974 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e14835fd-8092-449b-8ab6-aba1009250fd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:46:59.756635 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e14835fd-8092-449b-8ab6-aba1009250fd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:46:59.763535 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e14835fd-8092-449b-8ab6-aba1009250fd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:59.764018 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e14835fd-8092-449b-8ab6-aba1009250fd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:59.764441 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e14835fd-8092-449b-8ab6-aba1009250fd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:59.765139 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e14835fd-8092-449b-8ab6-aba1009250fd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:46:59.765575 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e14835fd-8092-449b-8ab6-aba1009250fd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:46:59.765991 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e14835fd-8092-449b-8ab6-aba1009250fd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:46:59.998200 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e14835fd-8092-449b-8ab6-aba1009250fd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:46:59.998707 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e14835fd-8092-449b-8ab6-aba1009250fd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:00.000196 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e14835fd-8092-449b-8ab6-aba1009250fd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:00.001340 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e14835fd-8092-449b-8ab6-aba1009250fd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1722 microversion: 2.20 time: 0.249846 Aug 04 21:47:00.001894 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 339/686] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:46:59 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:47:01.025316 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-dc2e3c78-338f-4b63-a5fb-680b76066b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:01.026437 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-dc2e3c78-338f-4b63-a5fb-680b76066b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:01.034063 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dc2e3c78-338f-4b63-a5fb-680b76066b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:01.042031 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dc2e3c78-338f-4b63-a5fb-680b76066b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:01.042031 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dc2e3c78-338f-4b63-a5fb-680b76066b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:01.042031 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dc2e3c78-338f-4b63-a5fb-680b76066b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:01.042031 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dc2e3c78-338f-4b63-a5fb-680b76066b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:01.042427 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dc2e3c78-338f-4b63-a5fb-680b76066b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:01.054567 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-272f3a4c-f177-4c23-acfc-f41673088a18 req-223a0fc3-1ebc-4f1b-87e0-4827cc3ee8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87934a42-5a51-4ba4-81ed-d07b785bc090", "name": "network-vif-deleted", "tag": "970090cc-8601-489b-8105-e93f171c77d4"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:47:01.069290 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-272f3a4c-f177-4c23-acfc-f41673088a18 req-223a0fc3-1ebc-4f1b-87e0-4827cc3ee8b5 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:01.070696 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-272f3a4c-f177-4c23-acfc-f41673088a18 req-223a0fc3-1ebc-4f1b-87e0-4827cc3ee8b5 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:01.070696 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-272f3a4c-f177-4c23-acfc-f41673088a18 req-223a0fc3-1ebc-4f1b-87e0-4827cc3ee8b5 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:01.089363 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-272f3a4c-f177-4c23-acfc-f41673088a18 req-223a0fc3-1ebc-4f1b-87e0-4827cc3ee8b5 service nova] Creating event network-vif-deleted:970090cc-8601-489b-8105-e93f171c77d4 for instance 87934a42-5a51-4ba4-81ed-d07b785bc090 on hv-cinder-85220 Aug 04 21:47:01.095417 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-272f3a4c-f177-4c23-acfc-f41673088a18 req-223a0fc3-1ebc-4f1b-87e0-4827cc3ee8b5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112711 Aug 04 21:47:01.096222 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 348/687] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:47:01.109226 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-dc2e3c78-338f-4b63-a5fb-680b76066b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:01.118795 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-dc2e3c78-338f-4b63-a5fb-680b76066b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:01.120420 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-dc2e3c78-338f-4b63-a5fb-680b76066b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:01.121918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-dc2e3c78-338f-4b63-a5fb-680b76066b99 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1654 microversion: 2.20 time: 0.100281 Aug 04 21:47:01.123001 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 340/688] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:47:01 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1654 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:47:02.148429 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6ce43f74-a76f-4be8-8f42-faf3ffc86da4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:02.150160 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-6ce43f74-a76f-4be8-8f42-faf3ffc86da4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:02.156863 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6ce43f74-a76f-4be8-8f42-faf3ffc86da4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:02.157348 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6ce43f74-a76f-4be8-8f42-faf3ffc86da4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:02.157777 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6ce43f74-a76f-4be8-8f42-faf3ffc86da4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:02.158503 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6ce43f74-a76f-4be8-8f42-faf3ffc86da4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:02.158952 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6ce43f74-a76f-4be8-8f42-faf3ffc86da4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:02.159435 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6ce43f74-a76f-4be8-8f42-faf3ffc86da4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:02.193488 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6ce43f74-a76f-4be8-8f42-faf3ffc86da4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:02.194318 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6ce43f74-a76f-4be8-8f42-faf3ffc86da4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:02.194964 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6ce43f74-a76f-4be8-8f42-faf3ffc86da4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:02.197943 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-6ce43f74-a76f-4be8-8f42-faf3ffc86da4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lazy-loading 'fault' on Instance uuid 87934a42-5a51-4ba4-81ed-d07b785bc090 {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:47:02.252972 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6ce43f74-a76f-4be8-8f42-faf3ffc86da4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:02.254681 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6ce43f74-a76f-4be8-8f42-faf3ffc86da4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:02.256151 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6ce43f74-a76f-4be8-8f42-faf3ffc86da4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:02.257307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-6ce43f74-a76f-4be8-8f42-faf3ffc86da4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 200 len: 1370 microversion: 2.20 time: 0.114913 Aug 04 21:47:02.257865 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 349/689] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:47:02 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 1370 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:47:03.281136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-31266683-abe6-4f25-8100-8266fba6126c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:03.281924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-31266683-abe6-4f25-8100-8266fba6126c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:03.289329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-31266683-abe6-4f25-8100-8266fba6126c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:03.290614 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-31266683-abe6-4f25-8100-8266fba6126c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:03.291068 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-31266683-abe6-4f25-8100-8266fba6126c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:03.291790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-31266683-abe6-4f25-8100-8266fba6126c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:03.292246 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-31266683-abe6-4f25-8100-8266fba6126c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:03.292669 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-31266683-abe6-4f25-8100-8266fba6126c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:03.307081 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-31266683-abe6-4f25-8100-8266fba6126c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] HTTP exception thrown: Instance 87934a42-5a51-4ba4-81ed-d07b785bc090 could not be found. Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-31266683-abe6-4f25-8100-8266fba6126c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Request method failure captured: Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 HTTP/1.1 Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7DzPBxDeOlTeT9BvnBMwEXrSxDm73hCt0hOs_FK-5ilkHyxmcwQj6NdZ5D5SFUhulh-8PvLB1pZ8-Jgg8W7XJw9xdjtn0MTb9pVSZ4Fq28GPc5yXgUKRG3B1oa1JlAo1jvNLkW2SCltjIZZczWIX_Cp-UtnI0tOtCJLxgUisUCsTyqA Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: 4b95ce24a4d34e379fa86c9114ece400 Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-703997672 Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:47:03.308759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:47:03.310499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4b95ce24a4d34e379fa86c9114ece400", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4b95ce24a4d34e379fa86c9114ece400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4b95ce24a4d34e379fa86c9114ece400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4b95ce24a4d34e379fa86c9114ece400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:47:03.310499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-AttachVolumeShelveTestJSON-703997672 Aug 04 21:47:03.310499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: 4b95ce24a4d34e379fa86c9114ece400 Aug 04 21:47:03.310499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-703997672 Aug 04 21:47:03.310499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-AttachVolumeShelveTestJSON-703997672-project Aug 04 21:47:03.310499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:47:03.310499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:47:03.310499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: 95fb2edf82644e7f8ce461fcbb52007b Aug 04 21:47:03.310499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-AttachVolumeShelveTestJSON-703997672-project Aug 04 21:47:03.310499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 21:47:03.310499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Instance 87934a42-5a51-4ba4-81ed-d07b785bc090 could not be found. Aug 04 21:47:03.310499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': '87934a42-5a51-4ba4-81ed-d07b785bc090'} Aug 04 21:47:03.311447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:47:03.311447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:47:03.311447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:47:03.311447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:47:03.311447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:47:03.311447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:47:03.311447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:47:03.311447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:47:03.311447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:47:03.311447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:47:03.311447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87934a42-5a51-4ba4-81ed-d07b785bc090 could not be found. Aug 04 21:47:03.311447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:47:03.311447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:47:03.311447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:47:03.311447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:47:03.311447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:47:03.311447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:47:03.311447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:47:03.311447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:47:03.311447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:47:03.312750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:47:03.312750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:47:03.312750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:47:03.312750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:47:03.312750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:47:03.312750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:47:03.312750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:47:03.312750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87934a42-5a51-4ba4-81ed-d07b785bc090 could not be found. Aug 04 21:47:03.312750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:47:03.312750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:47:03.312750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:47:03.312750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:47:03.312750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:47:03.312750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:47:03.312750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:47:03.312750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:47:03.312750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87934a42-5a51-4ba4-81ed-d07b785bc090 could not be found. Aug 04 21:47:03.312750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:47:03.313931 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-31266683-abe6-4f25-8100-8266fba6126c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Returning 404 to user: Instance 87934a42-5a51-4ba4-81ed-d07b785bc090 could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:47:03.313931 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-31266683-abe6-4f25-8100-8266fba6126c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 404 len: 111 microversion: 2.20 time: 0.032934 Aug 04 21:47:03.313931 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 341/690] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:47:03 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:47:03.320237 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-96e21d82-6641-4b9f-9ff6-81e475d5eb2f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '.version_select at 0x7f3c10e983a0>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:03.414739 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-96e21d82-6641-4b9f-9ff6-81e475d5eb2f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1583645689" status: 204 len: 0 microversion: 2.20 time: 0.099248 Aug 04 21:47:03.415330 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 350/691] 10.222.0.73 () {60 vars in 1262 bytes} [Thu Aug 4 21:47:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1583645689 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 21:47:04.184333 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-083ba8c9-63a4-48cc-84d5-8cb16779796f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Action: 'create', calling method: .version_select at 0x7f3c107d19d0>, body: {"keypair": {"name": "tempest-keypair-1176136291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqe0TduUr1oK7HLsmo7IQ/8p4fIJJOtLH/KZS6OZRC1kHmeb4WUbpJY7llLlrMa9Pb+nX9VPTqFV9dPqG0a4jjqey++kzXKXl3HsWAf+7RRyystPvcJyG0U3/faoC79YA=="}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:47:04.200324 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-083ba8c9-63a4-48cc-84d5-8cb16779796f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Getting quotas for project 4b95ce24a4d34e379fa86c9114ece400. Resources: {'key_pairs'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:47:04.204043 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-083ba8c9-63a4-48cc-84d5-8cb16779796f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Getting quotas for user 95fb2edf82644e7f8ce461fcbb52007b and project 4b95ce24a4d34e379fa86c9114ece400. Resources: {'key_pairs'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:47:04.283134 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-083ba8c9-63a4-48cc-84d5-8cb16779796f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.102717 Aug 04 21:47:04.283973 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 342/692] 10.222.0.73 () {62 vars in 1200 bytes} [Thu Aug 4 21:47:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 104 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 21:47:06.653032 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-9aa677d3-6c0d-43a3-a867-03029f8e3a93 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1073501435", "imageRef": "fca0c9ba-fb0a-4f30-932f-84d5253674ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4aeba8f5-6b21-4436-abd6-8d1c71bccde2"}], "security_groups": [{"name": "tempest-securitygroup--460753794"}], "key_name": "tempest-keypair-1176136291", "user_data": "}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:47:06.762887 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.network.neutron [None req-9aa677d3-6c0d-43a3-a867-03029f8e3a93 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] validate_networks() for [('4aeba8f5-6b21-4436-abd6-8d1c71bccde2', None, None, None, None, None)] {{(pid=136342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:47:07.184107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-9aa677d3-6c0d-43a3-a867-03029f8e3a93 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Flavor limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:47:07.184529 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-9aa677d3-6c0d-43a3-a867-03029f8e3a93 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Image limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:47:07.185004 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-9aa677d3-6c0d-43a3-a867-03029f8e3a93 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Flavor pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:47:07.185408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-9aa677d3-6c0d-43a3-a867-03029f8e3a93 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Image pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:47:07.185814 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-9aa677d3-6c0d-43a3-a867-03029f8e3a93 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:47:07.195604 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9aa677d3-6c0d-43a3-a867-03029f8e3a93 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:07.196083 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9aa677d3-6c0d-43a3-a867-03029f8e3a93 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:07.196511 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9aa677d3-6c0d-43a3-a867-03029f8e3a93 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:07.197230 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9aa677d3-6c0d-43a3-a867-03029f8e3a93 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:07.197681 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9aa677d3-6c0d-43a3-a867-03029f8e3a93 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:07.198122 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9aa677d3-6c0d-43a3-a867-03029f8e3a93 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:07.215042 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-9aa677d3-6c0d-43a3-a867-03029f8e3a93 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Getting quotas for project 4b95ce24a4d34e379fa86c9114ece400. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:47:07.218915 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-9aa677d3-6c0d-43a3-a867-03029f8e3a93 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Getting quotas for user 95fb2edf82644e7f8ce461fcbb52007b and project 4b95ce24a4d34e379fa86c9114ece400. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:47:07.229799 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-9aa677d3-6c0d-43a3-a867-03029f8e3a93 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Going to run 1 instances... {{(pid=136342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:47:07.232098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-9aa677d3-6c0d-43a3-a867-03029f8e3a93 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca0c9ba-fb0a-4f30-932f-84d5253674ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:47:07.352785 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-9aa677d3-6c0d-43a3-a867-03029f8e3a93 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.704077 Aug 04 21:47:07.353550 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 351/693] 10.222.0.73 () {62 vars in 1188 bytes} [Thu Aug 4 21:47:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 21:47:07.365420 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-21297aa9-164b-4dd8-b6fb-54c4912d346b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:07.366241 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-21297aa9-164b-4dd8-b6fb-54c4912d346b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:07.433128 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-21297aa9-164b-4dd8-b6fb-54c4912d346b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:07.440373 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-21297aa9-164b-4dd8-b6fb-54c4912d346b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:07.442783 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-21297aa9-164b-4dd8-b6fb-54c4912d346b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:07.443901 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-21297aa9-164b-4dd8-b6fb-54c4912d346b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1282 microversion: 2.20 time: 0.083523 Aug 04 21:47:07.444501 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 343/694] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:47:07 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1282 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:47:08.466951 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d3d4fce0-27ed-4542-8559-393d8e92caac tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:08.467559 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d3d4fce0-27ed-4542-8559-393d8e92caac tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:08.474801 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d3d4fce0-27ed-4542-8559-393d8e92caac tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:08.475284 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d3d4fce0-27ed-4542-8559-393d8e92caac tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:08.475715 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d3d4fce0-27ed-4542-8559-393d8e92caac tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:08.476402 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d3d4fce0-27ed-4542-8559-393d8e92caac tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:08.476853 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d3d4fce0-27ed-4542-8559-393d8e92caac tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:08.477281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d3d4fce0-27ed-4542-8559-393d8e92caac tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:08.539279 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d3d4fce0-27ed-4542-8559-393d8e92caac tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:08.547262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d3d4fce0-27ed-4542-8559-393d8e92caac tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:08.548767 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d3d4fce0-27ed-4542-8559-393d8e92caac tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:08.549865 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d3d4fce0-27ed-4542-8559-393d8e92caac tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1286 microversion: 2.20 time: 0.087470 Aug 04 21:47:08.550440 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 352/695] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:47:08 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:47:09.573042 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-610d0265-b209-4a74-8ea7-27936db5129e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:09.573763 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-610d0265-b209-4a74-8ea7-27936db5129e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:09.580377 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-610d0265-b209-4a74-8ea7-27936db5129e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:09.581013 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-610d0265-b209-4a74-8ea7-27936db5129e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:09.581528 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-610d0265-b209-4a74-8ea7-27936db5129e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:09.582836 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-610d0265-b209-4a74-8ea7-27936db5129e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:09.583367 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-610d0265-b209-4a74-8ea7-27936db5129e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:09.583860 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-610d0265-b209-4a74-8ea7-27936db5129e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:09.664685 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-610d0265-b209-4a74-8ea7-27936db5129e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:09.672848 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-610d0265-b209-4a74-8ea7-27936db5129e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:09.674406 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-610d0265-b209-4a74-8ea7-27936db5129e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:09.675551 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-610d0265-b209-4a74-8ea7-27936db5129e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1342 microversion: 2.20 time: 0.106667 Aug 04 21:47:09.676109 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 344/696] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:47:09 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1342 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:47:10.701258 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-1ac3a3bb-1105-4221-b084-aee733818d71 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:10.701826 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-1ac3a3bb-1105-4221-b084-aee733818d71 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:10.709382 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1ac3a3bb-1105-4221-b084-aee733818d71 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:10.714356 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1ac3a3bb-1105-4221-b084-aee733818d71 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:10.714356 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1ac3a3bb-1105-4221-b084-aee733818d71 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:10.714356 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1ac3a3bb-1105-4221-b084-aee733818d71 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:10.714356 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1ac3a3bb-1105-4221-b084-aee733818d71 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:10.714933 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1ac3a3bb-1105-4221-b084-aee733818d71 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:10.843248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1ac3a3bb-1105-4221-b084-aee733818d71 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:10.851787 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1ac3a3bb-1105-4221-b084-aee733818d71 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:10.853303 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1ac3a3bb-1105-4221-b084-aee733818d71 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:10.854432 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-1ac3a3bb-1105-4221-b084-aee733818d71 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1407 microversion: 2.20 time: 0.157185 Aug 04 21:47:10.854990 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 353/697] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:47:10 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:47:11.248288 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-5f6aa507-f27f-4478-8ed8-f813f8bf1379 req-980f03fb-ce15-4fbb-8ba5-3970a6a6796f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6a3daf-6b19-47d0-85ca-eed1eacb91ca", "tag": "0748a24c-fd32-415e-bade-f491bfffbd57"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:47:11.260128 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-5f6aa507-f27f-4478-8ed8-f813f8bf1379 req-980f03fb-ce15-4fbb-8ba5-3970a6a6796f service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:11.260602 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-5f6aa507-f27f-4478-8ed8-f813f8bf1379 req-980f03fb-ce15-4fbb-8ba5-3970a6a6796f service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:11.261026 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-5f6aa507-f27f-4478-8ed8-f813f8bf1379 req-980f03fb-ce15-4fbb-8ba5-3970a6a6796f service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:11.272975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-5f6aa507-f27f-4478-8ed8-f813f8bf1379 req-980f03fb-ce15-4fbb-8ba5-3970a6a6796f service nova] Creating event network-changed:0748a24c-fd32-415e-bade-f491bfffbd57 for instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca on hv-cinder-85220 Aug 04 21:47:11.277798 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-5f6aa507-f27f-4478-8ed8-f813f8bf1379 req-980f03fb-ce15-4fbb-8ba5-3970a6a6796f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034090 Aug 04 21:47:11.278593 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 345/698] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:47:11.877377 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-1c3067e4-7989-4c7a-825c-f33fc8066252 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:11.878121 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-1c3067e4-7989-4c7a-825c-f33fc8066252 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:11.884951 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c3067e4-7989-4c7a-825c-f33fc8066252 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:11.885506 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c3067e4-7989-4c7a-825c-f33fc8066252 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:11.886037 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c3067e4-7989-4c7a-825c-f33fc8066252 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:11.886783 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c3067e4-7989-4c7a-825c-f33fc8066252 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:11.887237 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c3067e4-7989-4c7a-825c-f33fc8066252 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:11.887649 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c3067e4-7989-4c7a-825c-f33fc8066252 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:12.033444 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1c3067e4-7989-4c7a-825c-f33fc8066252 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:12.042511 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1c3067e4-7989-4c7a-825c-f33fc8066252 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:12.044007 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1c3067e4-7989-4c7a-825c-f33fc8066252 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:12.045159 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-1c3067e4-7989-4c7a-825c-f33fc8066252 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1407 microversion: 2.20 time: 0.171708 Aug 04 21:47:12.045725 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 354/699] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:47:11 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:47:13.068823 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-30648ac3-1c41-4889-b23c-f3d122f98f3a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:13.069516 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-30648ac3-1c41-4889-b23c-f3d122f98f3a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:13.075660 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-30648ac3-1c41-4889-b23c-f3d122f98f3a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:13.076145 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-30648ac3-1c41-4889-b23c-f3d122f98f3a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:13.076584 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-30648ac3-1c41-4889-b23c-f3d122f98f3a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:13.077273 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-30648ac3-1c41-4889-b23c-f3d122f98f3a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:13.077729 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-30648ac3-1c41-4889-b23c-f3d122f98f3a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:13.078191 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-30648ac3-1c41-4889-b23c-f3d122f98f3a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:13.211615 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-30648ac3-1c41-4889-b23c-f3d122f98f3a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:13.219387 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-30648ac3-1c41-4889-b23c-f3d122f98f3a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:13.220878 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-30648ac3-1c41-4889-b23c-f3d122f98f3a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:13.221960 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-30648ac3-1c41-4889-b23c-f3d122f98f3a tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1407 microversion: 2.20 time: 0.157893 Aug 04 21:47:13.222537 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 346/700] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:47:13 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:47:14.245304 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-3c820717-cc93-4068-a1fa-4fccda559889 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:14.245903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-3c820717-cc93-4068-a1fa-4fccda559889 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:14.252308 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3c820717-cc93-4068-a1fa-4fccda559889 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:14.252785 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3c820717-cc93-4068-a1fa-4fccda559889 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:14.253217 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3c820717-cc93-4068-a1fa-4fccda559889 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:14.254638 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3c820717-cc93-4068-a1fa-4fccda559889 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:14.255110 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3c820717-cc93-4068-a1fa-4fccda559889 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:14.255530 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3c820717-cc93-4068-a1fa-4fccda559889 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:14.386312 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-3c820717-cc93-4068-a1fa-4fccda559889 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:14.394257 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-3c820717-cc93-4068-a1fa-4fccda559889 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:14.396874 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-3c820717-cc93-4068-a1fa-4fccda559889 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:14.397988 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-3c820717-cc93-4068-a1fa-4fccda559889 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1407 microversion: 2.20 time: 0.156549 Aug 04 21:47:14.398578 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 355/701] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:47:14 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:47:15.420646 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f71f1e52-cdb8-4815-8541-29f0fe1c4fc3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:15.421290 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-f71f1e52-cdb8-4815-8541-29f0fe1c4fc3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:15.428900 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f71f1e52-cdb8-4815-8541-29f0fe1c4fc3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:15.429413 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f71f1e52-cdb8-4815-8541-29f0fe1c4fc3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:15.429845 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f71f1e52-cdb8-4815-8541-29f0fe1c4fc3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:15.430572 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f71f1e52-cdb8-4815-8541-29f0fe1c4fc3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:15.431020 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f71f1e52-cdb8-4815-8541-29f0fe1c4fc3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:15.431443 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f71f1e52-cdb8-4815-8541-29f0fe1c4fc3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:15.562793 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f71f1e52-cdb8-4815-8541-29f0fe1c4fc3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:15.571441 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f71f1e52-cdb8-4815-8541-29f0fe1c4fc3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:15.572942 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f71f1e52-cdb8-4815-8541-29f0fe1c4fc3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:15.574056 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f71f1e52-cdb8-4815-8541-29f0fe1c4fc3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1407 microversion: 2.20 time: 0.157298 Aug 04 21:47:15.574609 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 347/702] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:47:15 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:47:16.595988 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e282ecf6-a87e-42d8-bf0a-f3a884f34e33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:16.596586 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e282ecf6-a87e-42d8-bf0a-f3a884f34e33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:16.606452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e282ecf6-a87e-42d8-bf0a-f3a884f34e33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:16.607046 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e282ecf6-a87e-42d8-bf0a-f3a884f34e33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:16.607354 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e282ecf6-a87e-42d8-bf0a-f3a884f34e33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:16.608046 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e282ecf6-a87e-42d8-bf0a-f3a884f34e33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:16.608494 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e282ecf6-a87e-42d8-bf0a-f3a884f34e33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:16.608914 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e282ecf6-a87e-42d8-bf0a-f3a884f34e33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:16.745463 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e282ecf6-a87e-42d8-bf0a-f3a884f34e33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:16.753597 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e282ecf6-a87e-42d8-bf0a-f3a884f34e33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:16.755157 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e282ecf6-a87e-42d8-bf0a-f3a884f34e33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:16.756245 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e282ecf6-a87e-42d8-bf0a-f3a884f34e33 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1407 microversion: 2.20 time: 0.164245 Aug 04 21:47:16.759152 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 356/703] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:47:16 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:47:17.778692 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2190fc41-bb69-40d0-90c2-76ffa1be84ff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:17.779299 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-2190fc41-bb69-40d0-90c2-76ffa1be84ff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:17.781764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=6 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:47:17.787546 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2190fc41-bb69-40d0-90c2-76ffa1be84ff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:17.788662 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2190fc41-bb69-40d0-90c2-76ffa1be84ff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:17.789104 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2190fc41-bb69-40d0-90c2-76ffa1be84ff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:17.789811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2190fc41-bb69-40d0-90c2-76ffa1be84ff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:17.790286 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2190fc41-bb69-40d0-90c2-76ffa1be84ff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:17.790730 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2190fc41-bb69-40d0-90c2-76ffa1be84ff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:17.924151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2190fc41-bb69-40d0-90c2-76ffa1be84ff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:17.932390 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2190fc41-bb69-40d0-90c2-76ffa1be84ff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:17.936262 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2190fc41-bb69-40d0-90c2-76ffa1be84ff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:17.936262 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2190fc41-bb69-40d0-90c2-76ffa1be84ff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1407 microversion: 2.20 time: 0.160240 Aug 04 21:47:17.936262 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 348/704] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:47:17 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:47:18.958149 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e1d78e37-532e-4c21-8b1c-873c0828fc47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:18.958739 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e1d78e37-532e-4c21-8b1c-873c0828fc47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:18.960718 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=2 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:47:18.961365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=6 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:47:18.966587 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e1d78e37-532e-4c21-8b1c-873c0828fc47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:18.969921 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e1d78e37-532e-4c21-8b1c-873c0828fc47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:18.969921 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e1d78e37-532e-4c21-8b1c-873c0828fc47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:18.969921 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e1d78e37-532e-4c21-8b1c-873c0828fc47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:18.969921 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e1d78e37-532e-4c21-8b1c-873c0828fc47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:18.970317 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e1d78e37-532e-4c21-8b1c-873c0828fc47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:19.100208 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e1d78e37-532e-4c21-8b1c-873c0828fc47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:19.107951 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e1d78e37-532e-4c21-8b1c-873c0828fc47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:19.109430 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e1d78e37-532e-4c21-8b1c-873c0828fc47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:19.110553 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e1d78e37-532e-4c21-8b1c-873c0828fc47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1407 microversion: 2.20 time: 0.157084 Aug 04 21:47:19.111110 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 357/705] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:47:18 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:47:19.813076 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-b9147ca5-dbbc-4b4d-a403-debaf377ae3d req-59606536-459c-401f-81fd-f3fc0f31ff59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6a3daf-6b19-47d0-85ca-eed1eacb91ca", "name": "network-vif-plugged", "status": "completed", "tag": "0748a24c-fd32-415e-bade-f491bfffbd57"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:47:19.823802 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-b9147ca5-dbbc-4b4d-a403-debaf377ae3d req-59606536-459c-401f-81fd-f3fc0f31ff59 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:19.824278 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-b9147ca5-dbbc-4b4d-a403-debaf377ae3d req-59606536-459c-401f-81fd-f3fc0f31ff59 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:19.824711 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-b9147ca5-dbbc-4b4d-a403-debaf377ae3d req-59606536-459c-401f-81fd-f3fc0f31ff59 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:19.838288 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-b9147ca5-dbbc-4b4d-a403-debaf377ae3d req-59606536-459c-401f-81fd-f3fc0f31ff59 service nova] Creating event network-vif-plugged:0748a24c-fd32-415e-bade-f491bfffbd57 for instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca on hv-cinder-85220 Aug 04 21:47:19.843337 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-b9147ca5-dbbc-4b4d-a403-debaf377ae3d req-59606536-459c-401f-81fd-f3fc0f31ff59 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093956 Aug 04 21:47:19.844144 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 349/706] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:47:20.133345 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-636827d9-82df-437c-8143-5eb341201d03 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:20.133946 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-636827d9-82df-437c-8143-5eb341201d03 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:20.140414 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-636827d9-82df-437c-8143-5eb341201d03 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:20.140893 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-636827d9-82df-437c-8143-5eb341201d03 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:20.141349 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-636827d9-82df-437c-8143-5eb341201d03 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:20.142061 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-636827d9-82df-437c-8143-5eb341201d03 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:20.142511 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-636827d9-82df-437c-8143-5eb341201d03 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:20.142926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-636827d9-82df-437c-8143-5eb341201d03 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:20.280147 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-636827d9-82df-437c-8143-5eb341201d03 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:20.288286 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-636827d9-82df-437c-8143-5eb341201d03 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:20.289780 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-636827d9-82df-437c-8143-5eb341201d03 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:20.290908 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-636827d9-82df-437c-8143-5eb341201d03 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1407 microversion: 2.20 time: 0.162283 Aug 04 21:47:20.291535 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 358/707] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:47:20 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:47:21.314922 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-30570741-225b-45bb-8236-0fa366c0ad18 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:21.315606 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-30570741-225b-45bb-8236-0fa366c0ad18 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:21.322432 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-30570741-225b-45bb-8236-0fa366c0ad18 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:21.322911 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-30570741-225b-45bb-8236-0fa366c0ad18 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:21.323344 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-30570741-225b-45bb-8236-0fa366c0ad18 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:21.324028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-30570741-225b-45bb-8236-0fa366c0ad18 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:21.324472 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-30570741-225b-45bb-8236-0fa366c0ad18 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:21.324889 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-30570741-225b-45bb-8236-0fa366c0ad18 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:21.459353 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-30570741-225b-45bb-8236-0fa366c0ad18 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:21.467536 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-30570741-225b-45bb-8236-0fa366c0ad18 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:21.469060 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-30570741-225b-45bb-8236-0fa366c0ad18 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:21.470247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-30570741-225b-45bb-8236-0fa366c0ad18 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1407 microversion: 2.20 time: 0.160072 Aug 04 21:47:21.470822 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 350/708] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:47:21 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:47:22.493301 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-1c1ccc97-b3bc-4ad6-9b39-ee42882923de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:22.493902 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-1c1ccc97-b3bc-4ad6-9b39-ee42882923de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:22.501001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c1ccc97-b3bc-4ad6-9b39-ee42882923de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:22.501476 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c1ccc97-b3bc-4ad6-9b39-ee42882923de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:22.501902 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c1ccc97-b3bc-4ad6-9b39-ee42882923de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:22.502611 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c1ccc97-b3bc-4ad6-9b39-ee42882923de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:22.503060 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c1ccc97-b3bc-4ad6-9b39-ee42882923de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:22.503480 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c1ccc97-b3bc-4ad6-9b39-ee42882923de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:22.641696 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1c1ccc97-b3bc-4ad6-9b39-ee42882923de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:22.650591 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1c1ccc97-b3bc-4ad6-9b39-ee42882923de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:22.652104 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1c1ccc97-b3bc-4ad6-9b39-ee42882923de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:22.653250 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-1c1ccc97-b3bc-4ad6-9b39-ee42882923de tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1407 microversion: 2.20 time: 0.163948 Aug 04 21:47:22.653904 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 359/709] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:47:22 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:47:23.676950 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ba3a1be1-7daa-434a-984d-fb92d2aa3966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:23.677472 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ba3a1be1-7daa-434a-984d-fb92d2aa3966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:23.683893 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ba3a1be1-7daa-434a-984d-fb92d2aa3966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:23.684369 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ba3a1be1-7daa-434a-984d-fb92d2aa3966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:23.684803 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ba3a1be1-7daa-434a-984d-fb92d2aa3966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:23.685488 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ba3a1be1-7daa-434a-984d-fb92d2aa3966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:23.685933 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ba3a1be1-7daa-434a-984d-fb92d2aa3966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:23.686452 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ba3a1be1-7daa-434a-984d-fb92d2aa3966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:23.814651 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ba3a1be1-7daa-434a-984d-fb92d2aa3966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:23.822845 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ba3a1be1-7daa-434a-984d-fb92d2aa3966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:23.824381 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ba3a1be1-7daa-434a-984d-fb92d2aa3966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:23.825542 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ba3a1be1-7daa-434a-984d-fb92d2aa3966 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1599 microversion: 2.20 time: 0.153191 Aug 04 21:47:23.826121 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 351/710] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:47:23 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:47:23.848945 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-048b55d8-a343-4b42-a5c4-e2d8e096c7f7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:23.849481 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-048b55d8-a343-4b42-a5c4-e2d8e096c7f7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:23.855949 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-048b55d8-a343-4b42-a5c4-e2d8e096c7f7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:23.856430 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-048b55d8-a343-4b42-a5c4-e2d8e096c7f7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:23.856864 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-048b55d8-a343-4b42-a5c4-e2d8e096c7f7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:23.857548 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-048b55d8-a343-4b42-a5c4-e2d8e096c7f7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:23.858026 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-048b55d8-a343-4b42-a5c4-e2d8e096c7f7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:23.858445 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-048b55d8-a343-4b42-a5c4-e2d8e096c7f7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:23.862051 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:47:23.936593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-048b55d8-a343-4b42-a5c4-e2d8e096c7f7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092457 Aug 04 21:47:23.937188 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 360/711] 10.222.0.73 () {60 vars in 1316 bytes} [Thu Aug 4 21:47:23 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:47:24.920063 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-df16965a-8180-46a4-a88d-1298516e1ef3 req-39bef0b6-3219-48ce-bc2e-d0776b1d4dbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6a3daf-6b19-47d0-85ca-eed1eacb91ca", "tag": "0748a24c-fd32-415e-bade-f491bfffbd57"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:47:24.925655 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:47:24.931052 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-df16965a-8180-46a4-a88d-1298516e1ef3 req-39bef0b6-3219-48ce-bc2e-d0776b1d4dbb service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:24.931531 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-df16965a-8180-46a4-a88d-1298516e1ef3 req-39bef0b6-3219-48ce-bc2e-d0776b1d4dbb service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:24.931954 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-df16965a-8180-46a4-a88d-1298516e1ef3 req-39bef0b6-3219-48ce-bc2e-d0776b1d4dbb service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:24.935834 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=79 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:47:24.943677 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-df16965a-8180-46a4-a88d-1298516e1ef3 req-39bef0b6-3219-48ce-bc2e-d0776b1d4dbb service nova] Creating event network-changed:0748a24c-fd32-415e-bade-f491bfffbd57 for instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca on hv-cinder-85220 Aug 04 21:47:24.948725 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-df16965a-8180-46a4-a88d-1298516e1ef3 req-39bef0b6-3219-48ce-bc2e-d0776b1d4dbb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032515 Aug 04 21:47:24.949394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 352/712] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:47:38.532275 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:47:38.537016 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-05e94b2a-2f41-4d4b-921d-41e7462da3b7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:38.539309 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-05e94b2a-2f41-4d4b-921d-41e7462da3b7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:38.545236 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-05e94b2a-2f41-4d4b-921d-41e7462da3b7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:38.545735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-05e94b2a-2f41-4d4b-921d-41e7462da3b7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:38.546201 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-05e94b2a-2f41-4d4b-921d-41e7462da3b7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:38.546946 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-05e94b2a-2f41-4d4b-921d-41e7462da3b7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:38.547403 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-05e94b2a-2f41-4d4b-921d-41e7462da3b7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:38.547827 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-05e94b2a-2f41-4d4b-921d-41e7462da3b7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:38.582523 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-05e94b2a-2f41-4d4b-921d-41e7462da3b7 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050769 Aug 04 21:47:38.583062 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 361/713] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:47:38 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:47:38.645984 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d2bebea6-8cbc-43cb-9064-b57c1d040b35 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:38.646582 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-d2bebea6-8cbc-43cb-9064-b57c1d040b35 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:38.653782 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d2bebea6-8cbc-43cb-9064-b57c1d040b35 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:38.654299 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d2bebea6-8cbc-43cb-9064-b57c1d040b35 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:38.654738 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d2bebea6-8cbc-43cb-9064-b57c1d040b35 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:38.655430 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d2bebea6-8cbc-43cb-9064-b57c1d040b35 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:38.655882 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d2bebea6-8cbc-43cb-9064-b57c1d040b35 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:38.656304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d2bebea6-8cbc-43cb-9064-b57c1d040b35 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:38.681569 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-d2bebea6-8cbc-43cb-9064-b57c1d040b35 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Going to try to terminate instance {{(pid=136341) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:47:38.983897 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d2bebea6-8cbc-43cb-9064-b57c1d040b35 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "DELETE /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 204 len: 0 microversion: 2.1 time: 0.342861 Aug 04 21:47:38.984484 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 353/714] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:47:38 2022] DELETE /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:47:38.993871 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-1f14e624-12fe-4c3a-9eb9-aa9eba298a13 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:38.997891 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-1f14e624-12fe-4c3a-9eb9-aa9eba298a13 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:39.001281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1f14e624-12fe-4c3a-9eb9-aa9eba298a13 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:39.001762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1f14e624-12fe-4c3a-9eb9-aa9eba298a13 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:39.002229 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1f14e624-12fe-4c3a-9eb9-aa9eba298a13 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:39.002946 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1f14e624-12fe-4c3a-9eb9-aa9eba298a13 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:39.003399 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1f14e624-12fe-4c3a-9eb9-aa9eba298a13 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:39.003917 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1f14e624-12fe-4c3a-9eb9-aa9eba298a13 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:39.134386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1f14e624-12fe-4c3a-9eb9-aa9eba298a13 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:39.141907 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-1f14e624-12fe-4c3a-9eb9-aa9eba298a13 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1671 microversion: 2.1 time: 0.152980 Aug 04 21:47:39.142429 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 362/715] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:38 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:47:40.165113 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f9889cac-0168-443c-b87b-8926181428a2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:40.165783 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-f9889cac-0168-443c-b87b-8926181428a2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:40.172141 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f9889cac-0168-443c-b87b-8926181428a2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:40.172627 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f9889cac-0168-443c-b87b-8926181428a2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:40.173060 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f9889cac-0168-443c-b87b-8926181428a2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:40.173745 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f9889cac-0168-443c-b87b-8926181428a2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:40.174224 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f9889cac-0168-443c-b87b-8926181428a2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:40.174647 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f9889cac-0168-443c-b87b-8926181428a2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:40.310015 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f9889cac-0168-443c-b87b-8926181428a2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:40.317762 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f9889cac-0168-443c-b87b-8926181428a2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1671 microversion: 2.1 time: 0.156874 Aug 04 21:47:40.318371 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 354/716] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:40 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:47:41.024920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4c67c55a-6952-4507-a72c-144f45902397 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:41.025473 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4c67c55a-6952-4507-a72c-144f45902397 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:41.032318 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c67c55a-6952-4507-a72c-144f45902397 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:41.032810 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c67c55a-6952-4507-a72c-144f45902397 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:41.033249 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c67c55a-6952-4507-a72c-144f45902397 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:41.033952 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c67c55a-6952-4507-a72c-144f45902397 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:41.034437 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c67c55a-6952-4507-a72c-144f45902397 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:41.035555 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c67c55a-6952-4507-a72c-144f45902397 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:41.118650 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-4c67c55a-6952-4507-a72c-144f45902397 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lazy-loading 'services' on Instance uuid c72a9092-7229-4677-9e8c-1849b5f3aaad {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:47:41.338283 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4c67c55a-6952-4507-a72c-144f45902397 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad/os-volume_attachments/153efaff-2cf0-4272-8ab7-6ac4024ff7f5" status: 202 len: 0 microversion: 2.1 time: 0.318749 Aug 04 21:47:41.342107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 363/717] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 4 21:47:41 2022] DELETE /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad/os-volume_attachments/153efaff-2cf0-4272-8ab7-6ac4024ff7f5 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:47:41.342242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-722048f5-ff2d-4e58-85bb-60f0fcfd1cf3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:41.342242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-722048f5-ff2d-4e58-85bb-60f0fcfd1cf3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:41.349939 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-50206845-dce5-454f-aef7-4bf100a0695e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:41.352663 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-50206845-dce5-454f-aef7-4bf100a0695e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:41.357182 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-722048f5-ff2d-4e58-85bb-60f0fcfd1cf3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:41.357698 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-722048f5-ff2d-4e58-85bb-60f0fcfd1cf3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:41.358190 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-722048f5-ff2d-4e58-85bb-60f0fcfd1cf3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:41.358905 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-722048f5-ff2d-4e58-85bb-60f0fcfd1cf3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:41.359361 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-722048f5-ff2d-4e58-85bb-60f0fcfd1cf3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:41.359786 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-722048f5-ff2d-4e58-85bb-60f0fcfd1cf3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:41.360466 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-50206845-dce5-454f-aef7-4bf100a0695e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:41.360956 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-50206845-dce5-454f-aef7-4bf100a0695e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:41.361925 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-50206845-dce5-454f-aef7-4bf100a0695e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:41.362861 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-50206845-dce5-454f-aef7-4bf100a0695e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:41.363325 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-50206845-dce5-454f-aef7-4bf100a0695e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:41.365013 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-50206845-dce5-454f-aef7-4bf100a0695e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:41.405220 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-50206845-dce5-454f-aef7-4bf100a0695e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061424 Aug 04 21:47:41.405988 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 364/718] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:47:41 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:47:41.460040 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-204030f2-e03f-49e4-a115-2205482b5238 req-52fa4b68-4ff2-44b6-9f91-08445ad8f048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbeea630-d67b-4f89-a329-c7066d506126", "name": "network-vif-deleted", "tag": "b245eeb4-95cf-45b5-8d69-591f776623e4"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:47:41.460604 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-722048f5-ff2d-4e58-85bb-60f0fcfd1cf3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:41.470076 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-722048f5-ff2d-4e58-85bb-60f0fcfd1cf3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1603 microversion: 2.1 time: 0.134897 Aug 04 21:47:41.474795 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-204030f2-e03f-49e4-a115-2205482b5238 req-52fa4b68-4ff2-44b6-9f91-08445ad8f048 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:41.475425 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-204030f2-e03f-49e4-a115-2205482b5238 req-52fa4b68-4ff2-44b6-9f91-08445ad8f048 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:41.476036 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-204030f2-e03f-49e4-a115-2205482b5238 req-52fa4b68-4ff2-44b6-9f91-08445ad8f048 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:41.482415 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 355/719] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:41 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1603 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:47:41.496822 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-204030f2-e03f-49e4-a115-2205482b5238 req-52fa4b68-4ff2-44b6-9f91-08445ad8f048 service nova] Creating event network-vif-deleted:b245eeb4-95cf-45b5-8d69-591f776623e4 for instance dbeea630-d67b-4f89-a329-c7066d506126 on hv-cinder-85220 Aug 04 21:47:41.502172 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-204030f2-e03f-49e4-a115-2205482b5238 req-52fa4b68-4ff2-44b6-9f91-08445ad8f048 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046441 Aug 04 21:47:41.507412 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 365/720] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:47:42.417506 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-45c02ce2-bf17-46df-9936-3f22f79aeedd tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:42.419710 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-45c02ce2-bf17-46df-9936-3f22f79aeedd tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:42.427216 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-45c02ce2-bf17-46df-9936-3f22f79aeedd tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:42.427717 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-45c02ce2-bf17-46df-9936-3f22f79aeedd tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:42.428159 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-45c02ce2-bf17-46df-9936-3f22f79aeedd tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:42.428869 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-45c02ce2-bf17-46df-9936-3f22f79aeedd tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:42.429321 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-45c02ce2-bf17-46df-9936-3f22f79aeedd tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:42.429748 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-45c02ce2-bf17-46df-9936-3f22f79aeedd tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:42.460304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-45c02ce2-bf17-46df-9936-3f22f79aeedd tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046668 Aug 04 21:47:42.461164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 356/721] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:47:42 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:47:42.497621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-c4695aa8-1d2f-4d29-834d-058dd640eea0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:42.498336 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-c4695aa8-1d2f-4d29-834d-058dd640eea0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:42.505457 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c4695aa8-1d2f-4d29-834d-058dd640eea0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:42.509585 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c4695aa8-1d2f-4d29-834d-058dd640eea0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:42.509585 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c4695aa8-1d2f-4d29-834d-058dd640eea0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:42.509585 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c4695aa8-1d2f-4d29-834d-058dd640eea0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:42.509585 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c4695aa8-1d2f-4d29-834d-058dd640eea0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:42.509993 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c4695aa8-1d2f-4d29-834d-058dd640eea0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:42.542879 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c4695aa8-1d2f-4d29-834d-058dd640eea0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:42.543274 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c4695aa8-1d2f-4d29-834d-058dd640eea0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:42.543700 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c4695aa8-1d2f-4d29-834d-058dd640eea0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:42.544135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-c4695aa8-1d2f-4d29-834d-058dd640eea0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lazy-loading 'fault' on Instance uuid dbeea630-d67b-4f89-a329-c7066d506126 {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:47:42.589747 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-c4695aa8-1d2f-4d29-834d-058dd640eea0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:42.603939 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-c4695aa8-1d2f-4d29-834d-058dd640eea0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 200 len: 1326 microversion: 2.1 time: 0.110764 Aug 04 21:47:42.604618 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 366/722] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:42 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 1326 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:47:43.473081 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a1482a06-9bca-4db3-b426-083a79affa0c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:43.475340 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a1482a06-9bca-4db3-b426-083a79affa0c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:43.481734 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a1482a06-9bca-4db3-b426-083a79affa0c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:43.484333 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a1482a06-9bca-4db3-b426-083a79affa0c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:43.484333 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a1482a06-9bca-4db3-b426-083a79affa0c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:43.484333 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a1482a06-9bca-4db3-b426-083a79affa0c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:43.484333 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a1482a06-9bca-4db3-b426-083a79affa0c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:43.484737 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a1482a06-9bca-4db3-b426-083a79affa0c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:43.513021 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a1482a06-9bca-4db3-b426-083a79affa0c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044605 Aug 04 21:47:43.513582 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 357/723] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:47:43 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:47:43.602846 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-3ae4d1ad-378e-44a3-abb0-8f5e23b3e9d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:43.603412 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-3ae4d1ad-378e-44a3-abb0-8f5e23b3e9d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:43.609187 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3ae4d1ad-378e-44a3-abb0-8f5e23b3e9d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:43.609674 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3ae4d1ad-378e-44a3-abb0-8f5e23b3e9d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:43.610140 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3ae4d1ad-378e-44a3-abb0-8f5e23b3e9d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:43.610831 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3ae4d1ad-378e-44a3-abb0-8f5e23b3e9d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:43.611282 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3ae4d1ad-378e-44a3-abb0-8f5e23b3e9d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:43.611705 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3ae4d1ad-378e-44a3-abb0-8f5e23b3e9d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:43.627906 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-da8ca355-86a8-4d1d-9ee0-847986c5f1c8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:43.629068 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-da8ca355-86a8-4d1d-9ee0-847986c5f1c8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:43.635436 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-da8ca355-86a8-4d1d-9ee0-847986c5f1c8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:43.635854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-da8ca355-86a8-4d1d-9ee0-847986c5f1c8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:43.636294 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-da8ca355-86a8-4d1d-9ee0-847986c5f1c8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:43.637016 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-da8ca355-86a8-4d1d-9ee0-847986c5f1c8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:43.637434 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-3ae4d1ad-378e-44a3-abb0-8f5e23b3e9d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Going to try to terminate instance {{(pid=136342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:47:43.637538 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-da8ca355-86a8-4d1d-9ee0-847986c5f1c8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:43.637877 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-da8ca355-86a8-4d1d-9ee0-847986c5f1c8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:43.652116 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-da8ca355-86a8-4d1d-9ee0-847986c5f1c8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] HTTP exception thrown: Instance dbeea630-d67b-4f89-a329-c7066d506126 could not be found. Aug 04 21:47:43.653772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-da8ca355-86a8-4d1d-9ee0-847986c5f1c8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Request method failure captured: Aug 04 21:47:43.653772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 HTTP/1.1 Aug 04 21:47:43.653772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:47:43.653772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:47:43.653772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:47:43.653772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 21:47:43.653772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:47:43.653772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:47:43.653772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:47:43.653772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:47:43.653772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7DzKJTsJAHPDhJ8CMuf9KkeK11MhLOSHwTHX7vzm8TbfgcJVNWjadZ85KdKsVcHVvFkKn0cT0xu9ul8CaY82QzjSHg1WGhr5_hU-MhpmSf7GBIM8UkxIT8_GJsae52KTrCsFMxroACrk7UlCOx-g-7Paunx7vrjm8yxNgR1ylXRGvVw Aug 04 21:47:43.653772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:47:43.653772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:47:43.653772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:47:43.653772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:47:43.653772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:47:43.653772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:47:43.653772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: 09370df0a2354bd2a412c6770d3ff165 Aug 04 21:47:43.653772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-AttachVolumeTestJSON-1799315316 Aug 04 21:47:43.653772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:47:43.653772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:47:43.655336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_09370df0a2354bd2a412c6770d3ff165", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/09370df0a2354bd2a412c6770d3ff165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/09370df0a2354bd2a412c6770d3ff165"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/09370df0a2354bd2a412c6770d3ff165"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:47:43.655336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-AttachVolumeTestJSON-1799315316 Aug 04 21:47:43.655336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: 09370df0a2354bd2a412c6770d3ff165 Aug 04 21:47:43.655336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1799315316 Aug 04 21:47:43.655336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-AttachVolumeTestJSON-1799315316-project Aug 04 21:47:43.655336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:47:43.655336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:47:43.655336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: a23fcabad2354e7ab51a22b412bf11e6 Aug 04 21:47:43.655336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-AttachVolumeTestJSON-1799315316-project Aug 04 21:47:43.655336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 21:47:43.655336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Instance dbeea630-d67b-4f89-a329-c7066d506126 could not be found. Aug 04 21:47:43.655336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': 'dbeea630-d67b-4f89-a329-c7066d506126'} Aug 04 21:47:43.656137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:47:43.656137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:47:43.656137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:47:43.656137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:47:43.656137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:47:43.656137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:47:43.656137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:47:43.656137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:47:43.656137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:47:43.656137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:47:43.656137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbeea630-d67b-4f89-a329-c7066d506126 could not be found. Aug 04 21:47:43.656137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:47:43.656137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:47:43.656137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:47:43.656137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:47:43.656137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:47:43.656137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:47:43.656137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:47:43.656137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:47:43.656137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:47:43.657447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:47:43.657447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:47:43.657447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:47:43.657447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:47:43.657447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:47:43.657447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:47:43.657447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:47:43.657447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbeea630-d67b-4f89-a329-c7066d506126 could not be found. Aug 04 21:47:43.657447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:47:43.657447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:47:43.657447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:47:43.657447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:47:43.657447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:47:43.657447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:47:43.657447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:47:43.657447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:47:43.657447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbeea630-d67b-4f89-a329-c7066d506126 could not be found. Aug 04 21:47:43.657447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:47:43.658598 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-da8ca355-86a8-4d1d-9ee0-847986c5f1c8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Returning 404 to user: Instance dbeea630-d67b-4f89-a329-c7066d506126 could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:47:43.658598 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-da8ca355-86a8-4d1d-9ee0-847986c5f1c8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 404 len: 111 microversion: 2.1 time: 0.031139 Aug 04 21:47:43.658598 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 358/724] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:43 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:47:43.664300 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d4ada866-9cc1-456f-bd59-1c3000a5233a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '.version_select at 0x7f3c10603820>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:43.750451 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d4ada866-9cc1-456f-bd59-1c3000a5233a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-429370592" status: 202 len: 0 microversion: 2.1 time: 0.090136 Aug 04 21:47:43.751062 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 359/725] 10.222.0.73 () {58 vars in 1218 bytes} [Thu Aug 4 21:47:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-429370592 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 21:47:43.904231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-3ae4d1ad-378e-44a3-abb0-8f5e23b3e9d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 204 len: 0 microversion: 2.1 time: 0.305115 Aug 04 21:47:43.904734 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 367/726] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:47:43 2022] DELETE /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:47:43.914679 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-4e7ea03c-d3b1-41d7-b7a5-3633b7df658c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:43.915355 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-4e7ea03c-d3b1-41d7-b7a5-3633b7df658c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:43.922723 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4e7ea03c-d3b1-41d7-b7a5-3633b7df658c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:43.923217 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4e7ea03c-d3b1-41d7-b7a5-3633b7df658c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:43.923655 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4e7ea03c-d3b1-41d7-b7a5-3633b7df658c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:43.924423 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4e7ea03c-d3b1-41d7-b7a5-3633b7df658c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:43.924877 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4e7ea03c-d3b1-41d7-b7a5-3633b7df658c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:43.926060 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4e7ea03c-d3b1-41d7-b7a5-3633b7df658c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:44.077345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4e7ea03c-d3b1-41d7-b7a5-3633b7df658c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:44.085675 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-4e7ea03c-d3b1-41d7-b7a5-3633b7df658c tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1691 microversion: 2.1 time: 0.176481 Aug 04 21:47:44.086499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 360/727] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:43 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:47:44.848965 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-248e19c6-c0cf-450c-a86c-5f3bbf1447b1 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Action: 'create', calling method: .version_select at 0x7f3c10fcbe50>, body: {"keypair": {"name": "tempest-keypair-1463358136", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMs3EvQ6018y2W0h2qNMvROI3IM5cryCUoSqC1Q3QouxVIn5ya7LmKE5y2JmQNs1FCjAbirDCTGXYcDk5Su1ACT1hEiQv2VcscFk4ZaGCmTldCocH02bLsAxRpWNGyDMw=="}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:47:44.869662 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-248e19c6-c0cf-450c-a86c-5f3bbf1447b1 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Getting quotas for project 09370df0a2354bd2a412c6770d3ff165. Resources: {'key_pairs'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:47:44.873727 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-248e19c6-c0cf-450c-a86c-5f3bbf1447b1 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Getting quotas for user a23fcabad2354e7ab51a22b412bf11e6 and project 09370df0a2354bd2a412c6770d3ff165. Resources: {'key_pairs'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:47:44.991482 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-248e19c6-c0cf-450c-a86c-5f3bbf1447b1 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.146728 Aug 04 21:47:44.991984 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 368/728] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 4 21:47:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:47:45.107707 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-3495de88-d01e-4cc6-9888-32d1e34df99f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:45.108322 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-3495de88-d01e-4cc6-9888-32d1e34df99f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:45.114936 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3495de88-d01e-4cc6-9888-32d1e34df99f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:45.115447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3495de88-d01e-4cc6-9888-32d1e34df99f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:45.115885 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3495de88-d01e-4cc6-9888-32d1e34df99f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:45.116587 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3495de88-d01e-4cc6-9888-32d1e34df99f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:45.117039 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3495de88-d01e-4cc6-9888-32d1e34df99f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:45.117460 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3495de88-d01e-4cc6-9888-32d1e34df99f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:45.249499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-3495de88-d01e-4cc6-9888-32d1e34df99f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:45.258128 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-3495de88-d01e-4cc6-9888-32d1e34df99f tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1691 microversion: 2.1 time: 0.154327 Aug 04 21:47:45.258693 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 361/729] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:45 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:47:46.280389 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4e58d1c4-6d98-42c1-b2ab-49dbd3d218e7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:46.281108 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4e58d1c4-6d98-42c1-b2ab-49dbd3d218e7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:46.287202 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4e58d1c4-6d98-42c1-b2ab-49dbd3d218e7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:46.287681 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4e58d1c4-6d98-42c1-b2ab-49dbd3d218e7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:46.288110 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4e58d1c4-6d98-42c1-b2ab-49dbd3d218e7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:46.288794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4e58d1c4-6d98-42c1-b2ab-49dbd3d218e7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:46.289241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4e58d1c4-6d98-42c1-b2ab-49dbd3d218e7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:46.289680 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4e58d1c4-6d98-42c1-b2ab-49dbd3d218e7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:46.513506 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4e58d1c4-6d98-42c1-b2ab-49dbd3d218e7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:46.522317 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4e58d1c4-6d98-42c1-b2ab-49dbd3d218e7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1691 microversion: 2.1 time: 0.246223 Aug 04 21:47:46.523212 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 369/730] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:46 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1691 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:47:47.505639 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-380ed31a-52ba-4328-b46b-418e6d08d7d6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-846250220", "imageRef": "fca0c9ba-fb0a-4f30-932f-84d5253674ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4b36145-27e4-4095-881b-72edbb672f32"}], "security_groups": [{"name": "tempest-securitygroup--137983980"}], "key_name": "tempest-keypair-1463358136", "user_data": "}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:47:47.544821 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-c64c00a5-2ded-49a2-874b-300d7b70761e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:47.546377 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-c64c00a5-2ded-49a2-874b-300d7b70761e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:47.554157 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c64c00a5-2ded-49a2-874b-300d7b70761e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:47.554647 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c64c00a5-2ded-49a2-874b-300d7b70761e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:47.555080 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c64c00a5-2ded-49a2-874b-300d7b70761e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:47.555771 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c64c00a5-2ded-49a2-874b-300d7b70761e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:47.556224 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c64c00a5-2ded-49a2-874b-300d7b70761e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:47.556649 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c64c00a5-2ded-49a2-874b-300d7b70761e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:47.625793 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.network.neutron [None req-380ed31a-52ba-4328-b46b-418e6d08d7d6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] validate_networks() for [('d4b36145-27e4-4095-881b-72edbb672f32', None, None, None, None, None)] {{(pid=136341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:47:47.692203 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-c64c00a5-2ded-49a2-874b-300d7b70761e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:47.699918 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-c64c00a5-2ded-49a2-874b-300d7b70761e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1691 microversion: 2.1 time: 0.158980 Aug 04 21:47:47.700482 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 370/731] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:47 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:47:48.459340 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-380ed31a-52ba-4328-b46b-418e6d08d7d6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Flavor limits 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:47:48.459757 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-380ed31a-52ba-4328-b46b-418e6d08d7d6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Image limits 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:47:48.460224 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-380ed31a-52ba-4328-b46b-418e6d08d7d6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Flavor pref 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:47:48.460635 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-380ed31a-52ba-4328-b46b-418e6d08d7d6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Image pref 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:47:48.461131 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-380ed31a-52ba-4328-b46b-418e6d08d7d6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:47:48.470039 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-380ed31a-52ba-4328-b46b-418e6d08d7d6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:48.470520 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-380ed31a-52ba-4328-b46b-418e6d08d7d6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:48.470948 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-380ed31a-52ba-4328-b46b-418e6d08d7d6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:48.471665 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-380ed31a-52ba-4328-b46b-418e6d08d7d6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:48.472657 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-380ed31a-52ba-4328-b46b-418e6d08d7d6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:48.473134 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-380ed31a-52ba-4328-b46b-418e6d08d7d6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:48.490947 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-380ed31a-52ba-4328-b46b-418e6d08d7d6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Getting quotas for project 09370df0a2354bd2a412c6770d3ff165. Resources: {'instances', 'cores', 'ram'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:47:48.495009 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-380ed31a-52ba-4328-b46b-418e6d08d7d6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Getting quotas for user a23fcabad2354e7ab51a22b412bf11e6 and project 09370df0a2354bd2a412c6770d3ff165. Resources: {'instances', 'cores', 'ram'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:47:48.506764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-380ed31a-52ba-4328-b46b-418e6d08d7d6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Going to run 1 instances... {{(pid=136341) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:47:48.509144 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-380ed31a-52ba-4328-b46b-418e6d08d7d6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca0c9ba-fb0a-4f30-932f-84d5253674ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:47:48.683524 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-380ed31a-52ba-4328-b46b-418e6d08d7d6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.182436 Aug 04 21:47:48.691524 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 362/732] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 4 21:47:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 1184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:47:48.697030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-985c76b7-0fa5-4a09-b684-adb4343a39f8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:48.697788 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-985c76b7-0fa5-4a09-b684-adb4343a39f8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:48.732956 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-297fe512-47ea-4f7e-a359-a563a7dfce2e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:48.733585 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-297fe512-47ea-4f7e-a359-a563a7dfce2e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:48.751205 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-297fe512-47ea-4f7e-a359-a563a7dfce2e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:48.754301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-297fe512-47ea-4f7e-a359-a563a7dfce2e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:48.754301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-297fe512-47ea-4f7e-a359-a563a7dfce2e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:48.754301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-297fe512-47ea-4f7e-a359-a563a7dfce2e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:48.754301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-297fe512-47ea-4f7e-a359-a563a7dfce2e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:48.755317 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-297fe512-47ea-4f7e-a359-a563a7dfce2e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:48.767934 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-985c76b7-0fa5-4a09-b684-adb4343a39f8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:48.776571 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-985c76b7-0fa5-4a09-b684-adb4343a39f8 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 200 len: 1237 microversion: 2.1 time: 0.083689 Aug 04 21:47:48.777767 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 371/733] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:48 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:47:48.929382 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-297fe512-47ea-4f7e-a359-a563a7dfce2e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:48.945910 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-297fe512-47ea-4f7e-a359-a563a7dfce2e tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1691 microversion: 2.1 time: 0.227408 Aug 04 21:47:48.948029 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 363/734] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:48 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1691 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:47:49.220984 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-f037f4b9-601a-4757-ae4d-694903a48eb1 req-340793ca-6669-4996-b6fa-0ec8a788a3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c72a9092-7229-4677-9e8c-1849b5f3aaad", "name": "network-vif-deleted", "tag": "0489e5c1-ed3b-4c8c-a0e2-848dabad5165"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:47:49.233840 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-f037f4b9-601a-4757-ae4d-694903a48eb1 req-340793ca-6669-4996-b6fa-0ec8a788a3e0 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:49.234359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-f037f4b9-601a-4757-ae4d-694903a48eb1 req-340793ca-6669-4996-b6fa-0ec8a788a3e0 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:49.235079 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-f037f4b9-601a-4757-ae4d-694903a48eb1 req-340793ca-6669-4996-b6fa-0ec8a788a3e0 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:49.247441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-f037f4b9-601a-4757-ae4d-694903a48eb1 req-340793ca-6669-4996-b6fa-0ec8a788a3e0 service nova] Creating event network-vif-deleted:0489e5c1-ed3b-4c8c-a0e2-848dabad5165 for instance c72a9092-7229-4677-9e8c-1849b5f3aaad on hv-cinder-85220 Aug 04 21:47:49.252873 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-f037f4b9-601a-4757-ae4d-694903a48eb1 req-340793ca-6669-4996-b6fa-0ec8a788a3e0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038034 Aug 04 21:47:49.253637 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 372/735] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:47:49.799674 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a1066ac7-9651-4565-839f-495b4261a13b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:49.800487 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a1066ac7-9651-4565-839f-495b4261a13b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:49.807251 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a1066ac7-9651-4565-839f-495b4261a13b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:49.807741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a1066ac7-9651-4565-839f-495b4261a13b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:49.808180 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a1066ac7-9651-4565-839f-495b4261a13b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:49.808958 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a1066ac7-9651-4565-839f-495b4261a13b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:49.809413 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a1066ac7-9651-4565-839f-495b4261a13b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:49.809840 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a1066ac7-9651-4565-839f-495b4261a13b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:49.880664 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a1066ac7-9651-4565-839f-495b4261a13b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:49.891488 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a1066ac7-9651-4565-839f-495b4261a13b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 200 len: 1241 microversion: 2.1 time: 0.096079 Aug 04 21:47:49.892122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 364/736] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:49 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:47:49.970986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b02f132c-6af5-4162-831b-175daec6e365 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:49.972040 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b02f132c-6af5-4162-831b-175daec6e365 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:49.979264 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b02f132c-6af5-4162-831b-175daec6e365 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:49.979757 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b02f132c-6af5-4162-831b-175daec6e365 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:49.980208 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b02f132c-6af5-4162-831b-175daec6e365 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:49.980928 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b02f132c-6af5-4162-831b-175daec6e365 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:49.981378 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b02f132c-6af5-4162-831b-175daec6e365 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:49.981796 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b02f132c-6af5-4162-831b-175daec6e365 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:50.016727 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b02f132c-6af5-4162-831b-175daec6e365 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:50.017212 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b02f132c-6af5-4162-831b-175daec6e365 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:50.017645 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b02f132c-6af5-4162-831b-175daec6e365 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:50.018123 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-b02f132c-6af5-4162-831b-175daec6e365 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lazy-loading 'fault' on Instance uuid c72a9092-7229-4677-9e8c-1849b5f3aaad {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:47:50.081441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b02f132c-6af5-4162-831b-175daec6e365 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:50.090164 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b02f132c-6af5-4162-831b-175daec6e365 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 200 len: 1335 microversion: 2.1 time: 0.123832 Aug 04 21:47:50.090763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 373/737] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:49 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 1335 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:47:50.914814 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-513ecb68-48f2-46ec-bfc5-11a67fc983a3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:50.915356 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-513ecb68-48f2-46ec-bfc5-11a67fc983a3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:50.921574 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-513ecb68-48f2-46ec-bfc5-11a67fc983a3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:50.922123 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-513ecb68-48f2-46ec-bfc5-11a67fc983a3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:50.922556 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-513ecb68-48f2-46ec-bfc5-11a67fc983a3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:50.923243 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-513ecb68-48f2-46ec-bfc5-11a67fc983a3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:50.923680 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-513ecb68-48f2-46ec-bfc5-11a67fc983a3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:50.924140 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-513ecb68-48f2-46ec-bfc5-11a67fc983a3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:50.987065 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-513ecb68-48f2-46ec-bfc5-11a67fc983a3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:50.995040 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-513ecb68-48f2-46ec-bfc5-11a67fc983a3 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 200 len: 1289 microversion: 2.1 time: 0.084128 Aug 04 21:47:50.995602 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 365/738] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:50 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 1289 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:47:51.112233 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f0c784cc-71a7-48a9-8d6a-2ba4de0c7877 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:51.113065 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-f0c784cc-71a7-48a9-8d6a-2ba4de0c7877 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: c72a9092-7229-4677-9e8c-1849b5f3aaad] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:51.119938 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f0c784cc-71a7-48a9-8d6a-2ba4de0c7877 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:51.120424 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f0c784cc-71a7-48a9-8d6a-2ba4de0c7877 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:51.120850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f0c784cc-71a7-48a9-8d6a-2ba4de0c7877 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:51.121547 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f0c784cc-71a7-48a9-8d6a-2ba4de0c7877 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:51.122277 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f0c784cc-71a7-48a9-8d6a-2ba4de0c7877 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:51.122697 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f0c784cc-71a7-48a9-8d6a-2ba4de0c7877 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:51.138169 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-f0c784cc-71a7-48a9-8d6a-2ba4de0c7877 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] HTTP exception thrown: Instance c72a9092-7229-4677-9e8c-1849b5f3aaad could not be found. Aug 04 21:47:51.139920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f0c784cc-71a7-48a9-8d6a-2ba4de0c7877 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Request method failure captured: Aug 04 21:47:51.139920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad HTTP/1.1 Aug 04 21:47:51.139920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:47:51.139920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:47:51.139920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:47:51.139920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:47:51.139920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:47:51.139920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:47:51.139920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:47:51.139920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:47:51.139920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7DzPr3cM533Uh9AlWXMHAOzqV7gXVwqd--0bCgLVckarAi2mkz1ojxMjcGyrQ_e6XAF05QDwl9mDP-ttkz96Zi6hf_R9XyiWCakQo1K49Ma92db_R5HUTLJxm7q8GtOr48qzTBtYaspx9TwpgWzcB1mofFXXnH8mJOATCThNeioonFw Aug 04 21:47:51.139920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:47:51.139920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:47:51.139920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:47:51.139920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:47:51.139920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:47:51.139920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:47:51.139920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: 26fb895147494be98bb6ceb8704984b7 Aug 04 21:47:51.139920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1281602055 Aug 04 21:47:51.139920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:47:51.139920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:47:51.141399 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_26fb895147494be98bb6ceb8704984b7", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/26fb895147494be98bb6ceb8704984b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/26fb895147494be98bb6ceb8704984b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/26fb895147494be98bb6ceb8704984b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:47:51.141399 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1281602055 Aug 04 21:47:51.141399 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: 26fb895147494be98bb6ceb8704984b7 Aug 04 21:47:51.141399 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1281602055 Aug 04 21:47:51.141399 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-ServerRescueNegativeTestJSON-1281602055-project Aug 04 21:47:51.141399 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:47:51.141399 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:47:51.141399 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: d9bc42bec393430b9b3e9399a8c4f95e Aug 04 21:47:51.141399 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1281602055-project Aug 04 21:47:51.141399 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:47:51.141399 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance c72a9092-7229-4677-9e8c-1849b5f3aaad could not be found. Aug 04 21:47:51.141399 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': 'c72a9092-7229-4677-9e8c-1849b5f3aaad'} Aug 04 21:47:51.142454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:47:51.142454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:47:51.142454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:47:51.142454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:47:51.142454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:47:51.142454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:47:51.142454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:47:51.142454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:47:51.142454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:47:51.142454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:47:51.142454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c72a9092-7229-4677-9e8c-1849b5f3aaad could not be found. Aug 04 21:47:51.142454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:47:51.142454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:47:51.142454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:47:51.142454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:47:51.142454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:47:51.142454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:47:51.142454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:47:51.142454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:47:51.142454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:47:51.143742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:47:51.143742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:47:51.143742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:47:51.143742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:47:51.143742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:47:51.143742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:47:51.143742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:47:51.143742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c72a9092-7229-4677-9e8c-1849b5f3aaad could not be found. Aug 04 21:47:51.143742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:47:51.143742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:47:51.143742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:47:51.143742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:47:51.143742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:47:51.143742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:47:51.143742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:47:51.143742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:47:51.143742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c72a9092-7229-4677-9e8c-1849b5f3aaad could not be found. Aug 04 21:47:51.143742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:47:51.145319 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f0c784cc-71a7-48a9-8d6a-2ba4de0c7877 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Returning 404 to user: Instance c72a9092-7229-4677-9e8c-1849b5f3aaad could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:47:51.145319 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-f0c784cc-71a7-48a9-8d6a-2ba4de0c7877 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad" status: 404 len: 111 microversion: 2.1 time: 0.033069 Aug 04 21:47:51.145319 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 374/739] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:51 2022] GET /compute/v2.1/servers/c72a9092-7229-4677-9e8c-1849b5f3aaad => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:47:51.150973 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e9b96da7-88a4-4650-a4de-96986e30a4be tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '.version_select at 0x7f3c106a0430>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:51.259932 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e9b96da7-88a4-4650-a4de-96986e30a4be tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368962378" status: 202 len: 0 microversion: 2.1 time: 0.112502 Aug 04 21:47:51.261119 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 366/740] 10.222.0.73 () {58 vars in 1221 bytes} [Thu Aug 4 21:47:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368962378 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:47:52.027010 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-47eb49f7-40f7-459d-97ba-a9b272953ed5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:52.027824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-47eb49f7-40f7-459d-97ba-a9b272953ed5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:52.039738 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-47eb49f7-40f7-459d-97ba-a9b272953ed5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:52.040212 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-47eb49f7-40f7-459d-97ba-a9b272953ed5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:52.040649 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-47eb49f7-40f7-459d-97ba-a9b272953ed5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:52.041363 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-47eb49f7-40f7-459d-97ba-a9b272953ed5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:52.042216 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-47eb49f7-40f7-459d-97ba-a9b272953ed5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:52.042555 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-47eb49f7-40f7-459d-97ba-a9b272953ed5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:52.277751 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-47eb49f7-40f7-459d-97ba-a9b272953ed5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:52.287463 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-47eb49f7-40f7-459d-97ba-a9b272953ed5 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 200 len: 1362 microversion: 2.1 time: 0.264920 Aug 04 21:47:52.292162 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 375/741] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:52 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:47:52.960822 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-9fe669ff-3407-4e48-ba32-ed8e7c23f395 req-49f9d95c-e851-451a-977c-4edbe3dfb751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce7b7159-6eae-4d5b-916c-43e4a21a6f60", "tag": "09cebf2f-8044-46a6-b504-0e5c712a09d9"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:47:52.971680 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-9fe669ff-3407-4e48-ba32-ed8e7c23f395 req-49f9d95c-e851-451a-977c-4edbe3dfb751 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:52.972311 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-9fe669ff-3407-4e48-ba32-ed8e7c23f395 req-49f9d95c-e851-451a-977c-4edbe3dfb751 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:52.972715 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-9fe669ff-3407-4e48-ba32-ed8e7c23f395 req-49f9d95c-e851-451a-977c-4edbe3dfb751 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:52.983044 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-9fe669ff-3407-4e48-ba32-ed8e7c23f395 req-49f9d95c-e851-451a-977c-4edbe3dfb751 service nova] Creating event network-changed:09cebf2f-8044-46a6-b504-0e5c712a09d9 for instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 on hv-cinder-85220 Aug 04 21:47:52.988723 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-9fe669ff-3407-4e48-ba32-ed8e7c23f395 req-49f9d95c-e851-451a-977c-4edbe3dfb751 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032652 Aug 04 21:47:52.989223 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 367/742] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:47:53.308685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e8a73bc3-9677-403d-961c-64a4e3d197aa tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:53.309321 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e8a73bc3-9677-403d-961c-64a4e3d197aa tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:53.315932 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e8a73bc3-9677-403d-961c-64a4e3d197aa tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:53.316452 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e8a73bc3-9677-403d-961c-64a4e3d197aa tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:53.316882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e8a73bc3-9677-403d-961c-64a4e3d197aa tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:53.317613 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e8a73bc3-9677-403d-961c-64a4e3d197aa tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:53.318145 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e8a73bc3-9677-403d-961c-64a4e3d197aa tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:53.318568 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e8a73bc3-9677-403d-961c-64a4e3d197aa tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:53.454572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e8a73bc3-9677-403d-961c-64a4e3d197aa tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:53.463604 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e8a73bc3-9677-403d-961c-64a4e3d197aa tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 200 len: 1362 microversion: 2.1 time: 0.158665 Aug 04 21:47:53.464182 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 376/743] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:53 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:47:54.485285 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-acac65b3-8092-4d96-bb28-5027622b17e0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:54.485980 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-acac65b3-8092-4d96-bb28-5027622b17e0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:54.492960 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-acac65b3-8092-4d96-bb28-5027622b17e0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:54.493440 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-acac65b3-8092-4d96-bb28-5027622b17e0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:54.493891 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-acac65b3-8092-4d96-bb28-5027622b17e0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:54.494603 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-acac65b3-8092-4d96-bb28-5027622b17e0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:54.495048 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-acac65b3-8092-4d96-bb28-5027622b17e0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:54.495462 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-acac65b3-8092-4d96-bb28-5027622b17e0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:54.632310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-acac65b3-8092-4d96-bb28-5027622b17e0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:54.639639 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-acac65b3-8092-4d96-bb28-5027622b17e0 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 200 len: 1362 microversion: 2.1 time: 0.159114 Aug 04 21:47:54.640196 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 368/744] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:54 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:47:54.838514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-0488a7d7-9d53-4d0e-9f72-f2ad630b6082 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:54.838996 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-0488a7d7-9d53-4d0e-9f72-f2ad630b6082 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:54.845361 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0488a7d7-9d53-4d0e-9f72-f2ad630b6082 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:54.845849 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0488a7d7-9d53-4d0e-9f72-f2ad630b6082 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:54.846326 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0488a7d7-9d53-4d0e-9f72-f2ad630b6082 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:54.847515 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0488a7d7-9d53-4d0e-9f72-f2ad630b6082 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:54.847967 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0488a7d7-9d53-4d0e-9f72-f2ad630b6082 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:54.848390 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0488a7d7-9d53-4d0e-9f72-f2ad630b6082 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:54.876223 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-0488a7d7-9d53-4d0e-9f72-f2ad630b6082 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Going to try to terminate instance {{(pid=136342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:47:54.890750 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:47:55.160851 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-0488a7d7-9d53-4d0e-9f72-f2ad630b6082 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "DELETE /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 204 len: 0 microversion: 2.1 time: 0.325747 Aug 04 21:47:55.161352 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 377/745] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:47:54 2022] DELETE /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:47:55.169425 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b1cf5d66-4586-4b10-b67d-eca6094ae7d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:55.170047 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b1cf5d66-4586-4b10-b67d-eca6094ae7d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:55.176198 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b1cf5d66-4586-4b10-b67d-eca6094ae7d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:55.177035 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b1cf5d66-4586-4b10-b67d-eca6094ae7d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:55.177151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b1cf5d66-4586-4b10-b67d-eca6094ae7d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:55.177765 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b1cf5d66-4586-4b10-b67d-eca6094ae7d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:55.178248 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b1cf5d66-4586-4b10-b67d-eca6094ae7d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:55.178670 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b1cf5d66-4586-4b10-b67d-eca6094ae7d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:55.312172 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b1cf5d66-4586-4b10-b67d-eca6094ae7d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:55.319713 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b1cf5d66-4586-4b10-b67d-eca6094ae7d8 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1509 microversion: 2.1 time: 0.154140 Aug 04 21:47:55.325077 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 369/746] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:55 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:47:55.662115 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-114e0d81-828c-4fe4-9e31-65ef32749d4c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:55.662838 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-114e0d81-828c-4fe4-9e31-65ef32749d4c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:55.669084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-114e0d81-828c-4fe4-9e31-65ef32749d4c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:55.669574 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-114e0d81-828c-4fe4-9e31-65ef32749d4c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:55.670033 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-114e0d81-828c-4fe4-9e31-65ef32749d4c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:55.670741 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-114e0d81-828c-4fe4-9e31-65ef32749d4c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:55.671195 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-114e0d81-828c-4fe4-9e31-65ef32749d4c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:55.671627 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-114e0d81-828c-4fe4-9e31-65ef32749d4c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:55.806532 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-114e0d81-828c-4fe4-9e31-65ef32749d4c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:55.813982 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-114e0d81-828c-4fe4-9e31-65ef32749d4c tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 200 len: 1362 microversion: 2.1 time: 0.156680 Aug 04 21:47:55.814642 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 378/747] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:55 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:47:56.340934 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d10f266f-a092-4fd2-999d-6a35a28d8241 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:56.341524 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-d10f266f-a092-4fd2-999d-6a35a28d8241 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:56.348768 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d10f266f-a092-4fd2-999d-6a35a28d8241 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:56.349247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d10f266f-a092-4fd2-999d-6a35a28d8241 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:56.349676 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d10f266f-a092-4fd2-999d-6a35a28d8241 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:56.350392 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d10f266f-a092-4fd2-999d-6a35a28d8241 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:56.350837 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d10f266f-a092-4fd2-999d-6a35a28d8241 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:56.351250 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d10f266f-a092-4fd2-999d-6a35a28d8241 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:56.480982 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d10f266f-a092-4fd2-999d-6a35a28d8241 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:56.488724 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d10f266f-a092-4fd2-999d-6a35a28d8241 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1509 microversion: 2.1 time: 0.151809 Aug 04 21:47:56.489287 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 370/748] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:56 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:47:56.836197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6ba4f13b-5955-42b5-9d2b-f66551d676ee tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:56.836929 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-6ba4f13b-5955-42b5-9d2b-f66551d676ee tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:56.843459 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6ba4f13b-5955-42b5-9d2b-f66551d676ee tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:56.843949 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6ba4f13b-5955-42b5-9d2b-f66551d676ee tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:56.844386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6ba4f13b-5955-42b5-9d2b-f66551d676ee tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:56.845087 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6ba4f13b-5955-42b5-9d2b-f66551d676ee tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:56.845545 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6ba4f13b-5955-42b5-9d2b-f66551d676ee tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:56.845974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6ba4f13b-5955-42b5-9d2b-f66551d676ee tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:56.977744 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6ba4f13b-5955-42b5-9d2b-f66551d676ee tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:56.985164 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-6ba4f13b-5955-42b5-9d2b-f66551d676ee tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 200 len: 1362 microversion: 2.1 time: 0.153216 Aug 04 21:47:56.985779 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 379/749] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:56 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:47:57.515820 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-475f5025-80c3-46aa-9cca-f4b65e5b4908 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:57.516384 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-475f5025-80c3-46aa-9cca-f4b65e5b4908 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:57.520359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-0d88aa53-c8b0-4fd9-9391-1b709eaa65b4 req-b1daa404-346b-4804-9dd3-1a4325bc3ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9770e069-e3a5-4f2e-95a2-8308c2580ec7", "name": "network-vif-deleted", "tag": "a31501ea-6fef-42f4-866e-93e03aeb08b1"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:47:57.533746 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-475f5025-80c3-46aa-9cca-f4b65e5b4908 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:57.536889 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-475f5025-80c3-46aa-9cca-f4b65e5b4908 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:57.540596 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-0d88aa53-c8b0-4fd9-9391-1b709eaa65b4 req-b1daa404-346b-4804-9dd3-1a4325bc3ac6 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:57.541193 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-475f5025-80c3-46aa-9cca-f4b65e5b4908 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:57.542069 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-475f5025-80c3-46aa-9cca-f4b65e5b4908 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:57.545542 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-475f5025-80c3-46aa-9cca-f4b65e5b4908 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:57.545542 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-475f5025-80c3-46aa-9cca-f4b65e5b4908 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:57.546023 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-0d88aa53-c8b0-4fd9-9391-1b709eaa65b4 req-b1daa404-346b-4804-9dd3-1a4325bc3ac6 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:57.546455 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-0d88aa53-c8b0-4fd9-9391-1b709eaa65b4 req-b1daa404-346b-4804-9dd3-1a4325bc3ac6 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:57.559276 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-0d88aa53-c8b0-4fd9-9391-1b709eaa65b4 req-b1daa404-346b-4804-9dd3-1a4325bc3ac6 service nova] Creating event network-vif-deleted:a31501ea-6fef-42f4-866e-93e03aeb08b1 for instance 9770e069-e3a5-4f2e-95a2-8308c2580ec7 on hv-cinder-85220 Aug 04 21:47:57.565278 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-0d88aa53-c8b0-4fd9-9391-1b709eaa65b4 req-b1daa404-346b-4804-9dd3-1a4325bc3ac6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059274 Aug 04 21:47:57.566525 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 380/750] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:47:57.617060 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-475f5025-80c3-46aa-9cca-f4b65e5b4908 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:57.619408 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:47:57.626073 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-475f5025-80c3-46aa-9cca-f4b65e5b4908 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 200 len: 1467 microversion: 2.1 time: 0.119283 Aug 04 21:47:57.626654 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 371/751] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:57 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 1467 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:47:58.008116 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-fa18e543-b4c2-44d3-8de7-60e0765d92a4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:58.008808 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-fa18e543-b4c2-44d3-8de7-60e0765d92a4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:58.015092 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fa18e543-b4c2-44d3-8de7-60e0765d92a4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:58.015579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fa18e543-b4c2-44d3-8de7-60e0765d92a4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:58.016006 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fa18e543-b4c2-44d3-8de7-60e0765d92a4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:58.016700 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fa18e543-b4c2-44d3-8de7-60e0765d92a4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:58.017144 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fa18e543-b4c2-44d3-8de7-60e0765d92a4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:58.017565 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fa18e543-b4c2-44d3-8de7-60e0765d92a4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:58.152755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-fa18e543-b4c2-44d3-8de7-60e0765d92a4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:58.160701 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-fa18e543-b4c2-44d3-8de7-60e0765d92a4 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 200 len: 1362 microversion: 2.1 time: 0.157883 Aug 04 21:47:58.161275 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 381/752] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:58 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:47:58.647560 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-96f0076c-57a1-4834-ae94-865f6df29fb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:58.648161 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-96f0076c-57a1-4834-ae94-865f6df29fb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: 9770e069-e3a5-4f2e-95a2-8308c2580ec7] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:58.650464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=2 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:47:58.651109 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=6 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:47:58.656751 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-96f0076c-57a1-4834-ae94-865f6df29fb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:58.657307 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-96f0076c-57a1-4834-ae94-865f6df29fb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:58.657738 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-96f0076c-57a1-4834-ae94-865f6df29fb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:58.658459 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-96f0076c-57a1-4834-ae94-865f6df29fb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:58.659130 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-96f0076c-57a1-4834-ae94-865f6df29fb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:58.659562 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-96f0076c-57a1-4834-ae94-865f6df29fb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:58.673136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-96f0076c-57a1-4834-ae94-865f6df29fb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] HTTP exception thrown: Instance 9770e069-e3a5-4f2e-95a2-8308c2580ec7 could not be found. Aug 04 21:47:58.674992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-96f0076c-57a1-4834-ae94-865f6df29fb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Request method failure captured: Aug 04 21:47:58.674992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 HTTP/1.1 Aug 04 21:47:58.674992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:47:58.674992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:47:58.674992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:47:58.674992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 21:47:58.674992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:47:58.674992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:47:58.674992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:47:58.674992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:47:58.674992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7DzPr3cM533Uh9AlWXMHAOzqV7gXVwqd--0bCgLVckarAi2mkz1ojxMjcGyrQ_e6XAF05QDwl9mDP-ttkz96Zi6hf_R9XyiWCakQo1K49Ma92db_R5HUTLJxm7q8GtOr48qzTBtYaspx9TwpgWzcB1mofFXXnH8mJOATCThNeioonFw Aug 04 21:47:58.674992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:47:58.674992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:47:58.674992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:47:58.674992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:47:58.674992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:47:58.674992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:47:58.674992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: 26fb895147494be98bb6ceb8704984b7 Aug 04 21:47:58.674992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1281602055 Aug 04 21:47:58.674992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:47:58.674992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:47:58.676597 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_26fb895147494be98bb6ceb8704984b7", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/26fb895147494be98bb6ceb8704984b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/26fb895147494be98bb6ceb8704984b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/26fb895147494be98bb6ceb8704984b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:47:58.676597 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1281602055 Aug 04 21:47:58.676597 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: 26fb895147494be98bb6ceb8704984b7 Aug 04 21:47:58.676597 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1281602055 Aug 04 21:47:58.676597 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-ServerRescueNegativeTestJSON-1281602055-project Aug 04 21:47:58.676597 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:47:58.676597 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:47:58.676597 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: d9bc42bec393430b9b3e9399a8c4f95e Aug 04 21:47:58.676597 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1281602055-project Aug 04 21:47:58.676597 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 21:47:58.676597 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Instance 9770e069-e3a5-4f2e-95a2-8308c2580ec7 could not be found. Aug 04 21:47:58.676597 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': '9770e069-e3a5-4f2e-95a2-8308c2580ec7'} Aug 04 21:47:58.677514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:47:58.677514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:47:58.677514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:47:58.677514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:47:58.677514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:47:58.677514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:47:58.677514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:47:58.677514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:47:58.677514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:47:58.677514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:47:58.677514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9770e069-e3a5-4f2e-95a2-8308c2580ec7 could not be found. Aug 04 21:47:58.677514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:47:58.677514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:47:58.677514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:47:58.677514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:47:58.677514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:47:58.677514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:47:58.677514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:47:58.677514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:47:58.677514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:47:58.678764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:47:58.678764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:47:58.678764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:47:58.678764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:47:58.678764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:47:58.678764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:47:58.678764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:47:58.678764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9770e069-e3a5-4f2e-95a2-8308c2580ec7 could not be found. Aug 04 21:47:58.678764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:47:58.678764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:47:58.678764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:47:58.678764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:47:58.678764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:47:58.678764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:47:58.678764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:47:58.678764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:47:58.678764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9770e069-e3a5-4f2e-95a2-8308c2580ec7 could not be found. Aug 04 21:47:58.678764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:47:58.679846 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-96f0076c-57a1-4834-ae94-865f6df29fb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Returning 404 to user: Instance 9770e069-e3a5-4f2e-95a2-8308c2580ec7 could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:47:58.679846 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-96f0076c-57a1-4834-ae94-865f6df29fb7 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7" status: 404 len: 111 microversion: 2.1 time: 0.033250 Aug 04 21:47:58.679846 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 372/753] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:58 2022] GET /compute/v2.1/servers/9770e069-e3a5-4f2e-95a2-8308c2580ec7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:47:58.684992 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-064008c1-3eca-4192-9e4e-e6afedc1e4d4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:58.685482 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-064008c1-3eca-4192-9e4e-e6afedc1e4d4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:58.692131 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-064008c1-3eca-4192-9e4e-e6afedc1e4d4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:58.692605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-064008c1-3eca-4192-9e4e-e6afedc1e4d4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:58.693029 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-064008c1-3eca-4192-9e4e-e6afedc1e4d4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:58.693705 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-064008c1-3eca-4192-9e4e-e6afedc1e4d4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:58.694187 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-064008c1-3eca-4192-9e4e-e6afedc1e4d4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:58.694608 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-064008c1-3eca-4192-9e4e-e6afedc1e4d4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:58.720133 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-064008c1-3eca-4192-9e4e-e6afedc1e4d4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Going to try to terminate instance {{(pid=136342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:47:58.776826 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=6 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:47:59.063857 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-064008c1-3eca-4192-9e4e-e6afedc1e4d4 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "DELETE /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 204 len: 0 microversion: 2.1 time: 0.382237 Aug 04 21:47:59.064606 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 382/754] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:47:58 2022] DELETE /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 21:47:59.074179 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-71de8c2e-f674-40e8-b2a0-90df5817e6e6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:59.074800 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-71de8c2e-f674-40e8-b2a0-90df5817e6e6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:59.082290 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-71de8c2e-f674-40e8-b2a0-90df5817e6e6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:59.082775 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-71de8c2e-f674-40e8-b2a0-90df5817e6e6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:59.083212 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-71de8c2e-f674-40e8-b2a0-90df5817e6e6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:59.083927 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-71de8c2e-f674-40e8-b2a0-90df5817e6e6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:59.084550 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-71de8c2e-f674-40e8-b2a0-90df5817e6e6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:59.084976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-71de8c2e-f674-40e8-b2a0-90df5817e6e6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:59.182030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-530df41c-6716-4e90-88f5-7b58305b2217 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:47:59.182901 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-530df41c-6716-4e90-88f5-7b58305b2217 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:47:59.189125 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-530df41c-6716-4e90-88f5-7b58305b2217 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:59.189619 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-530df41c-6716-4e90-88f5-7b58305b2217 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:59.190093 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-530df41c-6716-4e90-88f5-7b58305b2217 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:59.192352 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-530df41c-6716-4e90-88f5-7b58305b2217 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:59.192821 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-530df41c-6716-4e90-88f5-7b58305b2217 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:59.193288 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-530df41c-6716-4e90-88f5-7b58305b2217 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:59.224080 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-71de8c2e-f674-40e8-b2a0-90df5817e6e6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:59.231931 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-71de8c2e-f674-40e8-b2a0-90df5817e6e6 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1522 microversion: 2.1 time: 0.162508 Aug 04 21:47:59.235659 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 373/755] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:59 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:47:59.337205 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-530df41c-6716-4e90-88f5-7b58305b2217 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:47:59.344837 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-530df41c-6716-4e90-88f5-7b58305b2217 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 200 len: 1362 microversion: 2.1 time: 0.167276 Aug 04 21:47:59.345397 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 383/756] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:47:59 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:47:59.953439 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-bfbeb2e4-2ae7-484a-b214-644d881651ab req-0f438f21-e4e9-4dcc-a968-2c4759a83870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce7b7159-6eae-4d5b-916c-43e4a21a6f60", "name": "network-vif-plugged", "status": "completed", "tag": "09cebf2f-8044-46a6-b504-0e5c712a09d9"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:47:59.964335 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-bfbeb2e4-2ae7-484a-b214-644d881651ab req-0f438f21-e4e9-4dcc-a968-2c4759a83870 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:47:59.964844 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-bfbeb2e4-2ae7-484a-b214-644d881651ab req-0f438f21-e4e9-4dcc-a968-2c4759a83870 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:47:59.965264 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-bfbeb2e4-2ae7-484a-b214-644d881651ab req-0f438f21-e4e9-4dcc-a968-2c4759a83870 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:47:59.976971 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-bfbeb2e4-2ae7-484a-b214-644d881651ab req-0f438f21-e4e9-4dcc-a968-2c4759a83870 service nova] Creating event network-vif-plugged:09cebf2f-8044-46a6-b504-0e5c712a09d9 for instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 on hv-cinder-85220 Aug 04 21:47:59.981991 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-bfbeb2e4-2ae7-484a-b214-644d881651ab req-0f438f21-e4e9-4dcc-a968-2c4759a83870 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032611 Aug 04 21:47:59.982593 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 374/757] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:48:00.254761 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4c3da814-98ad-4f87-88aa-d011a3a261d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:48:00.255363 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4c3da814-98ad-4f87-88aa-d011a3a261d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:48:00.262252 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c3da814-98ad-4f87-88aa-d011a3a261d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:00.262744 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c3da814-98ad-4f87-88aa-d011a3a261d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:00.263180 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c3da814-98ad-4f87-88aa-d011a3a261d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:00.263883 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c3da814-98ad-4f87-88aa-d011a3a261d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:00.264339 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c3da814-98ad-4f87-88aa-d011a3a261d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:00.264758 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4c3da814-98ad-4f87-88aa-d011a3a261d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:00.366179 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-368dcbea-0eda-4d97-8a4f-62a368418667 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:48:00.366881 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-368dcbea-0eda-4d97-8a4f-62a368418667 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:48:00.373518 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-368dcbea-0eda-4d97-8a4f-62a368418667 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:00.374029 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-368dcbea-0eda-4d97-8a4f-62a368418667 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:00.374493 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-368dcbea-0eda-4d97-8a4f-62a368418667 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:00.375854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-368dcbea-0eda-4d97-8a4f-62a368418667 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:00.376333 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-368dcbea-0eda-4d97-8a4f-62a368418667 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:00.376763 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-368dcbea-0eda-4d97-8a4f-62a368418667 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:00.398548 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4c3da814-98ad-4f87-88aa-d011a3a261d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:48:00.406103 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4c3da814-98ad-4f87-88aa-d011a3a261d5 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1522 microversion: 2.1 time: 0.155734 Aug 04 21:48:00.406677 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 384/758] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:48:00 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:48:00.512549 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-368dcbea-0eda-4d97-8a4f-62a368418667 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:48:00.520936 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-368dcbea-0eda-4d97-8a4f-62a368418667 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 200 len: 1362 microversion: 2.1 time: 0.159081 Aug 04 21:48:00.521534 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 375/759] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:48:00 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:48:01.428125 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-50c08288-60f6-4b70-a4cc-9743fb88defb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:48:01.429047 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-50c08288-60f6-4b70-a4cc-9743fb88defb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:48:01.435851 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-50c08288-60f6-4b70-a4cc-9743fb88defb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:01.436479 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-50c08288-60f6-4b70-a4cc-9743fb88defb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:01.436992 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-50c08288-60f6-4b70-a4cc-9743fb88defb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:01.437764 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-50c08288-60f6-4b70-a4cc-9743fb88defb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:01.438250 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-50c08288-60f6-4b70-a4cc-9743fb88defb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:01.438678 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-50c08288-60f6-4b70-a4cc-9743fb88defb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:01.542467 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c38b7c89-8604-487f-85af-d861803acc87 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:48:01.543089 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c38b7c89-8604-487f-85af-d861803acc87 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:48:01.550775 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c38b7c89-8604-487f-85af-d861803acc87 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:01.551635 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c38b7c89-8604-487f-85af-d861803acc87 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:01.552195 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c38b7c89-8604-487f-85af-d861803acc87 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:01.553559 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c38b7c89-8604-487f-85af-d861803acc87 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:01.554049 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c38b7c89-8604-487f-85af-d861803acc87 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:01.554660 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c38b7c89-8604-487f-85af-d861803acc87 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:01.583858 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-50c08288-60f6-4b70-a4cc-9743fb88defb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:48:01.591610 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-50c08288-60f6-4b70-a4cc-9743fb88defb tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1522 microversion: 2.1 time: 0.168433 Aug 04 21:48:01.592193 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 385/760] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:48:01 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:48:01.695096 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-c38b7c89-8604-487f-85af-d861803acc87 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:48:01.702405 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c38b7c89-8604-487f-85af-d861803acc87 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 200 len: 1362 microversion: 2.1 time: 0.163942 Aug 04 21:48:01.702959 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 376/761] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:48:01 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:48:02.613084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4d507af5-9806-4a45-941e-3bcab8559ace tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:48:02.613680 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4d507af5-9806-4a45-941e-3bcab8559ace tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:48:02.620379 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d507af5-9806-4a45-941e-3bcab8559ace tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:02.620871 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d507af5-9806-4a45-941e-3bcab8559ace tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:02.621306 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d507af5-9806-4a45-941e-3bcab8559ace tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:02.622287 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d507af5-9806-4a45-941e-3bcab8559ace tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:02.622742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d507af5-9806-4a45-941e-3bcab8559ace tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:02.623163 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d507af5-9806-4a45-941e-3bcab8559ace tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:02.723480 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-98e14521-f5e2-4c17-a40e-d6a2396aa977 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:48:02.724365 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-98e14521-f5e2-4c17-a40e-d6a2396aa977 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:48:02.731156 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-98e14521-f5e2-4c17-a40e-d6a2396aa977 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:02.731743 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-98e14521-f5e2-4c17-a40e-d6a2396aa977 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:02.732251 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-98e14521-f5e2-4c17-a40e-d6a2396aa977 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:02.733026 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-98e14521-f5e2-4c17-a40e-d6a2396aa977 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:02.733551 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-98e14521-f5e2-4c17-a40e-d6a2396aa977 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:02.734793 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-98e14521-f5e2-4c17-a40e-d6a2396aa977 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:02.795283 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4d507af5-9806-4a45-941e-3bcab8559ace tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:48:02.803588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4d507af5-9806-4a45-941e-3bcab8559ace tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1522 microversion: 2.1 time: 0.194514 Aug 04 21:48:02.804168 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 386/762] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:48:02 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:48:02.872469 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-98e14521-f5e2-4c17-a40e-d6a2396aa977 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:48:02.881040 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-98e14521-f5e2-4c17-a40e-d6a2396aa977 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 200 len: 1362 microversion: 2.1 time: 0.161613 Aug 04 21:48:02.881676 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 377/763] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:48:02 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:48:02.957393 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-015515be-875e-4a99-9098-962a06ef5bbc req-8bc3d19d-0c3f-4fd2-8500-210c38855f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf234f88-9a79-4880-92c5-4d2a1c1c379f", "name": "network-vif-deleted", "tag": "2a939ca2-97e4-4f58-a55a-e99d3c75b212"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:48:02.966752 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-015515be-875e-4a99-9098-962a06ef5bbc req-8bc3d19d-0c3f-4fd2-8500-210c38855f02 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:02.967236 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-015515be-875e-4a99-9098-962a06ef5bbc req-8bc3d19d-0c3f-4fd2-8500-210c38855f02 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:02.967667 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-015515be-875e-4a99-9098-962a06ef5bbc req-8bc3d19d-0c3f-4fd2-8500-210c38855f02 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:02.980265 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-015515be-875e-4a99-9098-962a06ef5bbc req-8bc3d19d-0c3f-4fd2-8500-210c38855f02 service nova] Creating event network-vif-deleted:2a939ca2-97e4-4f58-a55a-e99d3c75b212 for instance cf234f88-9a79-4880-92c5-4d2a1c1c379f on hv-cinder-85220 Aug 04 21:48:02.985436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-015515be-875e-4a99-9098-962a06ef5bbc req-8bc3d19d-0c3f-4fd2-8500-210c38855f02 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032775 Aug 04 21:48:02.986054 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 387/764] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:48:03.824019 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-083e686b-2edd-4f68-b72f-2bbfa647e003 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:48:03.824624 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-083e686b-2edd-4f68-b72f-2bbfa647e003 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:48:03.832155 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-083e686b-2edd-4f68-b72f-2bbfa647e003 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:03.832637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-083e686b-2edd-4f68-b72f-2bbfa647e003 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:03.833064 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-083e686b-2edd-4f68-b72f-2bbfa647e003 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:03.833752 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-083e686b-2edd-4f68-b72f-2bbfa647e003 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:03.834231 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-083e686b-2edd-4f68-b72f-2bbfa647e003 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:03.834645 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-083e686b-2edd-4f68-b72f-2bbfa647e003 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:03.869122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-083e686b-2edd-4f68-b72f-2bbfa647e003 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:03.869613 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-083e686b-2edd-4f68-b72f-2bbfa647e003 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:03.870077 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-083e686b-2edd-4f68-b72f-2bbfa647e003 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:03.870532 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.objects.instance [None req-083e686b-2edd-4f68-b72f-2bbfa647e003 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lazy-loading 'fault' on Instance uuid cf234f88-9a79-4880-92c5-4d2a1c1c379f {{(pid=136341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:48:03.903192 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ef4b740f-c0b5-4071-a297-340c46a12379 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:48:03.904004 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ef4b740f-c0b5-4071-a297-340c46a12379 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:48:03.910830 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef4b740f-c0b5-4071-a297-340c46a12379 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:03.911406 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef4b740f-c0b5-4071-a297-340c46a12379 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:03.911912 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef4b740f-c0b5-4071-a297-340c46a12379 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:03.912702 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef4b740f-c0b5-4071-a297-340c46a12379 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:03.913225 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef4b740f-c0b5-4071-a297-340c46a12379 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:03.913802 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef4b740f-c0b5-4071-a297-340c46a12379 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:03.919391 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-083e686b-2edd-4f68-b72f-2bbfa647e003 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9bc42bec393430b9b3e9399a8c4f95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb895147494be98bb6ceb8704984b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:48:03.925775 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-083e686b-2edd-4f68-b72f-2bbfa647e003 tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 200 len: 1312 microversion: 2.1 time: 0.105669 Aug 04 21:48:03.926493 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 378/765] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:48:03 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:48:04.049918 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ef4b740f-c0b5-4071-a297-340c46a12379 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:48:04.057701 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ef4b740f-c0b5-4071-a297-340c46a12379 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 200 len: 1547 microversion: 2.1 time: 0.159208 Aug 04 21:48:04.058292 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 388/766] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:48:03 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:48:04.078627 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-eed4ad33-263e-4d60-a8bb-540f9b10262b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:48:04.079088 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-eed4ad33-263e-4d60-a8bb-540f9b10262b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:48:04.085779 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-eed4ad33-263e-4d60-a8bb-540f9b10262b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:04.086305 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-eed4ad33-263e-4d60-a8bb-540f9b10262b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:04.086734 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-eed4ad33-263e-4d60-a8bb-540f9b10262b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:04.087419 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-eed4ad33-263e-4d60-a8bb-540f9b10262b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:04.087866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-eed4ad33-263e-4d60-a8bb-540f9b10262b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:04.088288 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-eed4ad33-263e-4d60-a8bb-540f9b10262b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:04.166653 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-eed4ad33-263e-4d60-a8bb-540f9b10262b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091946 Aug 04 21:48:04.167248 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 379/767] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 4 21:48:04 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:48:04.946697 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a781ea32-88d2-4ac9-93a8-9869e875230d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:48:04.947300 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-a781ea32-88d2-4ac9-93a8-9869e875230d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] [instance: cf234f88-9a79-4880-92c5-4d2a1c1c379f] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:48:04.953722 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a781ea32-88d2-4ac9-93a8-9869e875230d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:04.954243 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a781ea32-88d2-4ac9-93a8-9869e875230d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:04.954673 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a781ea32-88d2-4ac9-93a8-9869e875230d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:04.955355 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a781ea32-88d2-4ac9-93a8-9869e875230d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:04.955963 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a781ea32-88d2-4ac9-93a8-9869e875230d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:04.956386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a781ea32-88d2-4ac9-93a8-9869e875230d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:04.969797 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-a781ea32-88d2-4ac9-93a8-9869e875230d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] HTTP exception thrown: Instance cf234f88-9a79-4880-92c5-4d2a1c1c379f could not be found. Aug 04 21:48:04.972017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a781ea32-88d2-4ac9-93a8-9869e875230d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Request method failure captured: Aug 04 21:48:04.972017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f HTTP/1.1 Aug 04 21:48:04.972017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:48:04.972017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:48:04.972017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:48:04.972017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:48:04.972017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:48:04.972017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:48:04.972017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:48:04.972017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:48:04.972017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7DzPr3cM533Uh9AlWXMHAOzqV7gXVwqd--0bCgLVckarAi2mkz1ojxMjcGyrQ_e6XAF05QDwl9mDP-ttkz96Zi6hf_R9XyiWCakQo1K49Ma92db_R5HUTLJxm7q8GtOr48qzTBtYaspx9TwpgWzcB1mofFXXnH8mJOATCThNeioonFw Aug 04 21:48:04.972017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:48:04.972017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:48:04.972017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:48:04.972017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:48:04.972017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:48:04.972017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:48:04.972017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: 26fb895147494be98bb6ceb8704984b7 Aug 04 21:48:04.972017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1281602055 Aug 04 21:48:04.972017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:48:04.972017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:48:04.973926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_26fb895147494be98bb6ceb8704984b7", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/26fb895147494be98bb6ceb8704984b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/26fb895147494be98bb6ceb8704984b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/26fb895147494be98bb6ceb8704984b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:48:04.973926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1281602055 Aug 04 21:48:04.973926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: 26fb895147494be98bb6ceb8704984b7 Aug 04 21:48:04.973926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1281602055 Aug 04 21:48:04.973926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-ServerRescueNegativeTestJSON-1281602055-project Aug 04 21:48:04.973926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:48:04.973926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:48:04.973926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: d9bc42bec393430b9b3e9399a8c4f95e Aug 04 21:48:04.973926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1281602055-project Aug 04 21:48:04.973926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:48:04.973926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance cf234f88-9a79-4880-92c5-4d2a1c1c379f could not be found. Aug 04 21:48:04.973926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': 'cf234f88-9a79-4880-92c5-4d2a1c1c379f'} Aug 04 21:48:04.975001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:48:04.975001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:48:04.975001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:48:04.975001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:48:04.975001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:48:04.975001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:48:04.975001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:48:04.975001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:48:04.975001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:48:04.975001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:48:04.975001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf234f88-9a79-4880-92c5-4d2a1c1c379f could not be found. Aug 04 21:48:04.975001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:48:04.975001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:48:04.975001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:48:04.975001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:48:04.975001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:48:04.975001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:48:04.975001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:48:04.975001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:48:04.975001 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:48:04.976605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:48:04.976605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:48:04.976605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:48:04.976605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:48:04.976605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:48:04.976605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:48:04.976605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:48:04.976605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf234f88-9a79-4880-92c5-4d2a1c1c379f could not be found. Aug 04 21:48:04.976605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:48:04.976605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:48:04.976605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:48:04.976605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:48:04.976605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:48:04.976605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:48:04.976605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:48:04.976605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:48:04.976605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf234f88-9a79-4880-92c5-4d2a1c1c379f could not be found. Aug 04 21:48:04.976605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:48:04.978239 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a781ea32-88d2-4ac9-93a8-9869e875230d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] Returning 404 to user: Instance cf234f88-9a79-4880-92c5-4d2a1c1c379f could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:48:04.978239 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-a781ea32-88d2-4ac9-93a8-9869e875230d tempest-ServerRescueNegativeTestJSON-1281602055 tempest-ServerRescueNegativeTestJSON-1281602055-project] 10.222.0.73 "GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f" status: 404 len: 111 microversion: 2.1 time: 0.030938 Aug 04 21:48:04.978239 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 389/768] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:48:04 2022] GET /compute/v2.1/servers/cf234f88-9a79-4880-92c5-4d2a1c1c379f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:48:05.453447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-1159c6ab-d61c-4704-b32b-c9cc1e5050a5 req-0bd8b68a-682e-42fc-b2a2-aceeec6fb6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce7b7159-6eae-4d5b-916c-43e4a21a6f60", "tag": "09cebf2f-8044-46a6-b504-0e5c712a09d9"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:48:05.464399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-1159c6ab-d61c-4704-b32b-c9cc1e5050a5 req-0bd8b68a-682e-42fc-b2a2-aceeec6fb6a5 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:05.466285 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-1159c6ab-d61c-4704-b32b-c9cc1e5050a5 req-0bd8b68a-682e-42fc-b2a2-aceeec6fb6a5 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:05.466285 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-1159c6ab-d61c-4704-b32b-c9cc1e5050a5 req-0bd8b68a-682e-42fc-b2a2-aceeec6fb6a5 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:05.478200 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-1159c6ab-d61c-4704-b32b-c9cc1e5050a5 req-0bd8b68a-682e-42fc-b2a2-aceeec6fb6a5 service nova] Creating event network-changed:09cebf2f-8044-46a6-b504-0e5c712a09d9 for instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 on hv-cinder-85220 Aug 04 21:48:05.483631 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-1159c6ab-d61c-4704-b32b-c9cc1e5050a5 req-0bd8b68a-682e-42fc-b2a2-aceeec6fb6a5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034319 Aug 04 21:48:05.484485 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 380/769] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:48:51.741297 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-95cbb6d6-5623-4cf6-b0be-fa5ae8ba9d4d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:48:51.741915 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-95cbb6d6-5623-4cf6-b0be-fa5ae8ba9d4d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:48:51.745650 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:48:51.746338 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:48:51.750164 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-95cbb6d6-5623-4cf6-b0be-fa5ae8ba9d4d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:51.756892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-95cbb6d6-5623-4cf6-b0be-fa5ae8ba9d4d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:51.756892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-95cbb6d6-5623-4cf6-b0be-fa5ae8ba9d4d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:51.756892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-95cbb6d6-5623-4cf6-b0be-fa5ae8ba9d4d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:51.756892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-95cbb6d6-5623-4cf6-b0be-fa5ae8ba9d4d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:51.757305 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-95cbb6d6-5623-4cf6-b0be-fa5ae8ba9d4d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:51.779428 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-95cbb6d6-5623-4cf6-b0be-fa5ae8ba9d4d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca/ips" status: 200 len: 151 microversion: 2.20 time: 0.042037 Aug 04 21:48:51.779988 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 390/770] 10.222.0.73 () {60 vars in 1289 bytes} [Thu Aug 4 21:48:51 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:48:55.024445 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:48:55.025222 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=43 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:48:55.033483 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ed02380e-4f53-4c46-a2af-d1ddea1eb6d8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:48:55.033483 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ed02380e-4f53-4c46-a2af-d1ddea1eb6d8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:48:55.042750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ed02380e-4f53-4c46-a2af-d1ddea1eb6d8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:55.043238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ed02380e-4f53-4c46-a2af-d1ddea1eb6d8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:55.043673 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ed02380e-4f53-4c46-a2af-d1ddea1eb6d8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:55.044379 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ed02380e-4f53-4c46-a2af-d1ddea1eb6d8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:55.044822 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ed02380e-4f53-4c46-a2af-d1ddea1eb6d8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:55.045240 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ed02380e-4f53-4c46-a2af-d1ddea1eb6d8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:55.070888 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.objects.instance [None req-ed02380e-4f53-4c46-a2af-d1ddea1eb6d8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lazy-loading 'flavor' on Instance uuid 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca {{(pid=136341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:48:55.511670 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ed02380e-4f53-4c46-a2af-d1ddea1eb6d8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "POST /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca/action" status: 202 len: 0 microversion: 2.20 time: 0.488661 Aug 04 21:48:55.512280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 381/771] 10.222.0.73 () {62 vars in 1319 bytes} [Thu Aug 4 21:48:55 2022] POST /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:48:55.522967 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6366760f-b901-4018-a279-01b2a0daa393 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:48:55.524697 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-6366760f-b901-4018-a279-01b2a0daa393 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:48:55.532337 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6366760f-b901-4018-a279-01b2a0daa393 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:55.532833 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6366760f-b901-4018-a279-01b2a0daa393 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:55.533273 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6366760f-b901-4018-a279-01b2a0daa393 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:55.533972 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6366760f-b901-4018-a279-01b2a0daa393 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:55.534467 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6366760f-b901-4018-a279-01b2a0daa393 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:55.534874 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6366760f-b901-4018-a279-01b2a0daa393 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:55.676586 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6366760f-b901-4018-a279-01b2a0daa393 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:48:55.684582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6366760f-b901-4018-a279-01b2a0daa393 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:48:55.686108 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6366760f-b901-4018-a279-01b2a0daa393 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:48:55.687331 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-6366760f-b901-4018-a279-01b2a0daa393 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1723 microversion: 2.20 time: 0.170645 Aug 04 21:48:55.687887 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 391/772] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:48:55 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:48:56.712065 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-5fe6b60e-cb9e-4adf-be46-e5d6661ffa5e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:48:56.712761 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-5fe6b60e-cb9e-4adf-be46-e5d6661ffa5e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:48:56.718976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5fe6b60e-cb9e-4adf-be46-e5d6661ffa5e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:56.719460 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5fe6b60e-cb9e-4adf-be46-e5d6661ffa5e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:56.719897 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5fe6b60e-cb9e-4adf-be46-e5d6661ffa5e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:56.720589 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5fe6b60e-cb9e-4adf-be46-e5d6661ffa5e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:56.721045 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5fe6b60e-cb9e-4adf-be46-e5d6661ffa5e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:56.721467 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5fe6b60e-cb9e-4adf-be46-e5d6661ffa5e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:56.862325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5fe6b60e-cb9e-4adf-be46-e5d6661ffa5e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:48:56.871193 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5fe6b60e-cb9e-4adf-be46-e5d6661ffa5e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:48:56.872963 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5fe6b60e-cb9e-4adf-be46-e5d6661ffa5e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:48:56.874178 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-5fe6b60e-cb9e-4adf-be46-e5d6661ffa5e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1723 microversion: 2.20 time: 0.167280 Aug 04 21:48:56.874783 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 382/773] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:48:56 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:48:57.898479 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-c745d222-3d21-4d9c-9c33-947d76653823 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:48:57.899143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-c745d222-3d21-4d9c-9c33-947d76653823 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:48:57.905858 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c745d222-3d21-4d9c-9c33-947d76653823 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:57.906454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c745d222-3d21-4d9c-9c33-947d76653823 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:57.907710 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c745d222-3d21-4d9c-9c33-947d76653823 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:57.907710 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c745d222-3d21-4d9c-9c33-947d76653823 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:57.908015 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c745d222-3d21-4d9c-9c33-947d76653823 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:57.908436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c745d222-3d21-4d9c-9c33-947d76653823 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:58.053316 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-c745d222-3d21-4d9c-9c33-947d76653823 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:48:58.061988 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-c745d222-3d21-4d9c-9c33-947d76653823 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:48:58.063632 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-c745d222-3d21-4d9c-9c33-947d76653823 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:48:58.064875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-c745d222-3d21-4d9c-9c33-947d76653823 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1723 microversion: 2.20 time: 0.172079 Aug 04 21:48:58.065518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 392/774] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:48:57 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:48:59.089409 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-8097d9e0-4b4d-4090-a85a-f8ff55b364cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:48:59.090032 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-8097d9e0-4b4d-4090-a85a-f8ff55b364cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:48:59.096589 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8097d9e0-4b4d-4090-a85a-f8ff55b364cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:59.097082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8097d9e0-4b4d-4090-a85a-f8ff55b364cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:59.097516 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8097d9e0-4b4d-4090-a85a-f8ff55b364cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:59.099052 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8097d9e0-4b4d-4090-a85a-f8ff55b364cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:48:59.099622 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8097d9e0-4b4d-4090-a85a-f8ff55b364cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:48:59.100071 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8097d9e0-4b4d-4090-a85a-f8ff55b364cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:48:59.235282 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8097d9e0-4b4d-4090-a85a-f8ff55b364cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:48:59.243849 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8097d9e0-4b4d-4090-a85a-f8ff55b364cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:48:59.245385 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8097d9e0-4b4d-4090-a85a-f8ff55b364cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:48:59.246668 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-8097d9e0-4b4d-4090-a85a-f8ff55b364cd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1723 microversion: 2.20 time: 0.161219 Aug 04 21:48:59.247488 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 383/775] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:48:59 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:00.272033 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-9fce7f9e-2308-4bc2-b95d-d25ed40a2e9f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:00.276779 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-9fce7f9e-2308-4bc2-b95d-d25ed40a2e9f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:00.279225 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9fce7f9e-2308-4bc2-b95d-d25ed40a2e9f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:00.279706 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9fce7f9e-2308-4bc2-b95d-d25ed40a2e9f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:00.280129 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9fce7f9e-2308-4bc2-b95d-d25ed40a2e9f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:00.280813 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9fce7f9e-2308-4bc2-b95d-d25ed40a2e9f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:00.281438 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9fce7f9e-2308-4bc2-b95d-d25ed40a2e9f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:00.281990 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9fce7f9e-2308-4bc2-b95d-d25ed40a2e9f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:00.428513 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-9fce7f9e-2308-4bc2-b95d-d25ed40a2e9f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:00.437043 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-9fce7f9e-2308-4bc2-b95d-d25ed40a2e9f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:00.439101 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-9fce7f9e-2308-4bc2-b95d-d25ed40a2e9f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:00.440333 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-9fce7f9e-2308-4bc2-b95d-d25ed40a2e9f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1723 microversion: 2.20 time: 0.173446 Aug 04 21:49:00.440898 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 393/776] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:00 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:49:01.464387 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-15d6259e-2072-4644-8025-9cc8645a323b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:01.464986 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-15d6259e-2072-4644-8025-9cc8645a323b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:01.471445 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-15d6259e-2072-4644-8025-9cc8645a323b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:01.471873 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-15d6259e-2072-4644-8025-9cc8645a323b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:01.472302 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-15d6259e-2072-4644-8025-9cc8645a323b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:01.473748 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-15d6259e-2072-4644-8025-9cc8645a323b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:01.474263 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-15d6259e-2072-4644-8025-9cc8645a323b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:01.474678 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-15d6259e-2072-4644-8025-9cc8645a323b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:01.614838 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-15d6259e-2072-4644-8025-9cc8645a323b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:01.624384 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-15d6259e-2072-4644-8025-9cc8645a323b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:01.625884 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-15d6259e-2072-4644-8025-9cc8645a323b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:01.627079 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-15d6259e-2072-4644-8025-9cc8645a323b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1723 microversion: 2.20 time: 0.166580 Aug 04 21:49:01.633367 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 384/777] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:01 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:02.655060 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e6236cb7-946d-4948-ad95-79931e1530f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:02.655603 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e6236cb7-946d-4948-ad95-79931e1530f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:02.662068 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e6236cb7-946d-4948-ad95-79931e1530f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:02.662561 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e6236cb7-946d-4948-ad95-79931e1530f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:02.663043 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e6236cb7-946d-4948-ad95-79931e1530f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:02.663876 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e6236cb7-946d-4948-ad95-79931e1530f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:02.664334 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e6236cb7-946d-4948-ad95-79931e1530f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:02.664764 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e6236cb7-946d-4948-ad95-79931e1530f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:02.799214 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e6236cb7-946d-4948-ad95-79931e1530f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:02.807798 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e6236cb7-946d-4948-ad95-79931e1530f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:02.809301 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e6236cb7-946d-4948-ad95-79931e1530f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:02.815364 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e6236cb7-946d-4948-ad95-79931e1530f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1723 microversion: 2.20 time: 0.159494 Aug 04 21:49:02.815364 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 394/778] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:02 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:03.833982 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-06c95c6d-98f7-4fb6-b8d0-938d90409420 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:03.834557 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-06c95c6d-98f7-4fb6-b8d0-938d90409420 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:03.841591 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-06c95c6d-98f7-4fb6-b8d0-938d90409420 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:03.842103 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-06c95c6d-98f7-4fb6-b8d0-938d90409420 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:03.842537 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-06c95c6d-98f7-4fb6-b8d0-938d90409420 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:03.843221 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-06c95c6d-98f7-4fb6-b8d0-938d90409420 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:03.843669 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-06c95c6d-98f7-4fb6-b8d0-938d90409420 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:03.844088 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-06c95c6d-98f7-4fb6-b8d0-938d90409420 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:03.969950 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-06c95c6d-98f7-4fb6-b8d0-938d90409420 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:03.978235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-06c95c6d-98f7-4fb6-b8d0-938d90409420 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:03.979732 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-06c95c6d-98f7-4fb6-b8d0-938d90409420 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:03.980962 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-06c95c6d-98f7-4fb6-b8d0-938d90409420 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1723 microversion: 2.20 time: 0.151073 Aug 04 21:49:03.981512 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 385/779] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:03 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:05.004588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-7c16309e-d95a-4f13-9da3-b01ab66d252c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:05.005185 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7c16309e-d95a-4f13-9da3-b01ab66d252c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:05.012308 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c16309e-d95a-4f13-9da3-b01ab66d252c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:05.012785 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c16309e-d95a-4f13-9da3-b01ab66d252c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:05.013212 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c16309e-d95a-4f13-9da3-b01ab66d252c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:05.013890 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c16309e-d95a-4f13-9da3-b01ab66d252c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:05.014385 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c16309e-d95a-4f13-9da3-b01ab66d252c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:05.014804 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7c16309e-d95a-4f13-9da3-b01ab66d252c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:05.143855 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7c16309e-d95a-4f13-9da3-b01ab66d252c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:05.152023 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7c16309e-d95a-4f13-9da3-b01ab66d252c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:05.153509 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7c16309e-d95a-4f13-9da3-b01ab66d252c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:05.154707 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-7c16309e-d95a-4f13-9da3-b01ab66d252c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1723 microversion: 2.20 time: 0.154208 Aug 04 21:49:05.155337 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 395/780] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:04 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:49:06.176857 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-868ad826-ad1d-4898-8a23-367f8b3c6a16 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:06.177460 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-868ad826-ad1d-4898-8a23-367f8b3c6a16 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:06.183954 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-868ad826-ad1d-4898-8a23-367f8b3c6a16 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:06.184428 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-868ad826-ad1d-4898-8a23-367f8b3c6a16 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:06.184892 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-868ad826-ad1d-4898-8a23-367f8b3c6a16 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:06.185566 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-868ad826-ad1d-4898-8a23-367f8b3c6a16 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:06.186023 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-868ad826-ad1d-4898-8a23-367f8b3c6a16 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:06.189844 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-868ad826-ad1d-4898-8a23-367f8b3c6a16 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:06.319517 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-868ad826-ad1d-4898-8a23-367f8b3c6a16 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:06.327929 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-868ad826-ad1d-4898-8a23-367f8b3c6a16 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:06.329411 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-868ad826-ad1d-4898-8a23-367f8b3c6a16 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:06.330581 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-868ad826-ad1d-4898-8a23-367f8b3c6a16 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1723 microversion: 2.20 time: 0.157815 Aug 04 21:49:06.331133 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 386/781] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:06 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:07.354349 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-bb216b94-9b0b-4f94-b7ac-a3ac1cdc9901 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:07.354960 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-bb216b94-9b0b-4f94-b7ac-a3ac1cdc9901 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:07.361433 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bb216b94-9b0b-4f94-b7ac-a3ac1cdc9901 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:07.361918 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bb216b94-9b0b-4f94-b7ac-a3ac1cdc9901 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:07.362417 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bb216b94-9b0b-4f94-b7ac-a3ac1cdc9901 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:07.366213 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bb216b94-9b0b-4f94-b7ac-a3ac1cdc9901 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:07.366213 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bb216b94-9b0b-4f94-b7ac-a3ac1cdc9901 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:07.366213 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bb216b94-9b0b-4f94-b7ac-a3ac1cdc9901 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:07.515960 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-bb216b94-9b0b-4f94-b7ac-a3ac1cdc9901 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:07.525961 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-bb216b94-9b0b-4f94-b7ac-a3ac1cdc9901 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:07.527078 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-bb216b94-9b0b-4f94-b7ac-a3ac1cdc9901 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:07.528379 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-bb216b94-9b0b-4f94-b7ac-a3ac1cdc9901 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1723 microversion: 2.20 time: 0.178488 Aug 04 21:49:07.528979 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 396/782] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:07 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:08.551494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-4a8bb1bc-7221-4800-8740-7be5715417b8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:08.552104 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-4a8bb1bc-7221-4800-8740-7be5715417b8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:08.559463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4a8bb1bc-7221-4800-8740-7be5715417b8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:08.559946 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4a8bb1bc-7221-4800-8740-7be5715417b8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:08.560432 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4a8bb1bc-7221-4800-8740-7be5715417b8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:08.561294 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4a8bb1bc-7221-4800-8740-7be5715417b8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:08.561748 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4a8bb1bc-7221-4800-8740-7be5715417b8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:08.562205 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4a8bb1bc-7221-4800-8740-7be5715417b8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:08.698702 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4a8bb1bc-7221-4800-8740-7be5715417b8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:08.706884 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4a8bb1bc-7221-4800-8740-7be5715417b8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:08.708563 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4a8bb1bc-7221-4800-8740-7be5715417b8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:08.709733 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-4a8bb1bc-7221-4800-8740-7be5715417b8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1723 microversion: 2.20 time: 0.162117 Aug 04 21:49:08.710386 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 387/783] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:08 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:09.734289 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-90b086f9-07e8-4505-9044-837eba9cd87b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:09.734993 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-90b086f9-07e8-4505-9044-837eba9cd87b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:09.741477 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-90b086f9-07e8-4505-9044-837eba9cd87b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:09.743631 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-90b086f9-07e8-4505-9044-837eba9cd87b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:09.743631 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-90b086f9-07e8-4505-9044-837eba9cd87b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:09.743844 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-90b086f9-07e8-4505-9044-837eba9cd87b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:09.744114 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-90b086f9-07e8-4505-9044-837eba9cd87b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:09.744533 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-90b086f9-07e8-4505-9044-837eba9cd87b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:09.878347 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-90b086f9-07e8-4505-9044-837eba9cd87b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:09.886341 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-90b086f9-07e8-4505-9044-837eba9cd87b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:09.887887 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-90b086f9-07e8-4505-9044-837eba9cd87b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:09.889028 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-90b086f9-07e8-4505-9044-837eba9cd87b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1723 microversion: 2.20 time: 0.158674 Aug 04 21:49:09.889577 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 397/784] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:09 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:10.911926 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-291f34cb-9a3b-4fdc-a78b-67b611c885a1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:10.912548 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-291f34cb-9a3b-4fdc-a78b-67b611c885a1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:10.918908 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-291f34cb-9a3b-4fdc-a78b-67b611c885a1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:10.919387 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-291f34cb-9a3b-4fdc-a78b-67b611c885a1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:10.919814 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-291f34cb-9a3b-4fdc-a78b-67b611c885a1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:10.920502 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-291f34cb-9a3b-4fdc-a78b-67b611c885a1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:10.920946 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-291f34cb-9a3b-4fdc-a78b-67b611c885a1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:10.921364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-291f34cb-9a3b-4fdc-a78b-67b611c885a1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:11.052711 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-291f34cb-9a3b-4fdc-a78b-67b611c885a1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:11.061221 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-291f34cb-9a3b-4fdc-a78b-67b611c885a1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:11.062767 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-291f34cb-9a3b-4fdc-a78b-67b611c885a1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:11.065151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-291f34cb-9a3b-4fdc-a78b-67b611c885a1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1723 microversion: 2.20 time: 0.155861 Aug 04 21:49:11.065151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 388/785] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:10 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:12.089309 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-03a3e0cf-c9fa-4b9f-9c6d-8d8e92ad29e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:12.089904 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-03a3e0cf-c9fa-4b9f-9c6d-8d8e92ad29e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:12.096328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03a3e0cf-c9fa-4b9f-9c6d-8d8e92ad29e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:12.096803 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03a3e0cf-c9fa-4b9f-9c6d-8d8e92ad29e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:12.097229 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03a3e0cf-c9fa-4b9f-9c6d-8d8e92ad29e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:12.097912 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03a3e0cf-c9fa-4b9f-9c6d-8d8e92ad29e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:12.098383 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03a3e0cf-c9fa-4b9f-9c6d-8d8e92ad29e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:12.098799 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03a3e0cf-c9fa-4b9f-9c6d-8d8e92ad29e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:12.233748 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-03a3e0cf-c9fa-4b9f-9c6d-8d8e92ad29e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:12.242032 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-03a3e0cf-c9fa-4b9f-9c6d-8d8e92ad29e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:12.243568 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-03a3e0cf-c9fa-4b9f-9c6d-8d8e92ad29e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:12.245495 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-03a3e0cf-c9fa-4b9f-9c6d-8d8e92ad29e7 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1723 microversion: 2.20 time: 0.161375 Aug 04 21:49:12.246118 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 398/786] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:12 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:13.268962 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-48ed3d8f-1b23-4d77-b4f4-9f9784b5a3f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:13.269581 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-48ed3d8f-1b23-4d77-b4f4-9f9784b5a3f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:13.275997 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-48ed3d8f-1b23-4d77-b4f4-9f9784b5a3f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:13.276473 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-48ed3d8f-1b23-4d77-b4f4-9f9784b5a3f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:13.276906 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-48ed3d8f-1b23-4d77-b4f4-9f9784b5a3f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:13.277592 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-48ed3d8f-1b23-4d77-b4f4-9f9784b5a3f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:13.278060 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-48ed3d8f-1b23-4d77-b4f4-9f9784b5a3f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:13.278485 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-48ed3d8f-1b23-4d77-b4f4-9f9784b5a3f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:13.413730 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-48ed3d8f-1b23-4d77-b4f4-9f9784b5a3f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:13.422185 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-48ed3d8f-1b23-4d77-b4f4-9f9784b5a3f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:13.423917 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-48ed3d8f-1b23-4d77-b4f4-9f9784b5a3f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:13.425096 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-48ed3d8f-1b23-4d77-b4f4-9f9784b5a3f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1744 microversion: 2.20 time: 0.160050 Aug 04 21:49:13.427560 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 389/787] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:13 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:14.456676 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-31b9ef63-4f8b-4d2d-87ea-c6e7fd164ea1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:14.457366 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-31b9ef63-4f8b-4d2d-87ea-c6e7fd164ea1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:14.463578 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-31b9ef63-4f8b-4d2d-87ea-c6e7fd164ea1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:14.467029 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-31b9ef63-4f8b-4d2d-87ea-c6e7fd164ea1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:14.467029 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-31b9ef63-4f8b-4d2d-87ea-c6e7fd164ea1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:14.467029 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-31b9ef63-4f8b-4d2d-87ea-c6e7fd164ea1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:14.467029 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-31b9ef63-4f8b-4d2d-87ea-c6e7fd164ea1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:14.467447 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-31b9ef63-4f8b-4d2d-87ea-c6e7fd164ea1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:14.612721 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-31b9ef63-4f8b-4d2d-87ea-c6e7fd164ea1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:14.624569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-31b9ef63-4f8b-4d2d-87ea-c6e7fd164ea1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:14.626559 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-31b9ef63-4f8b-4d2d-87ea-c6e7fd164ea1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:14.627740 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-31b9ef63-4f8b-4d2d-87ea-c6e7fd164ea1 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1744 microversion: 2.20 time: 0.175035 Aug 04 21:49:14.628302 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 399/788] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:14 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1744 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:15.658623 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-22e6aa15-9f03-4fa2-ae2d-8a34bf4069bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:15.661624 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-22e6aa15-9f03-4fa2-ae2d-8a34bf4069bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:15.667539 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-22e6aa15-9f03-4fa2-ae2d-8a34bf4069bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:15.668032 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-22e6aa15-9f03-4fa2-ae2d-8a34bf4069bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:15.668486 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-22e6aa15-9f03-4fa2-ae2d-8a34bf4069bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:15.669181 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-22e6aa15-9f03-4fa2-ae2d-8a34bf4069bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:15.669631 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-22e6aa15-9f03-4fa2-ae2d-8a34bf4069bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:15.670071 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-22e6aa15-9f03-4fa2-ae2d-8a34bf4069bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:15.805403 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-22e6aa15-9f03-4fa2-ae2d-8a34bf4069bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:15.813805 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-22e6aa15-9f03-4fa2-ae2d-8a34bf4069bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:15.815375 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-22e6aa15-9f03-4fa2-ae2d-8a34bf4069bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:15.816558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-22e6aa15-9f03-4fa2-ae2d-8a34bf4069bf tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1744 microversion: 2.20 time: 0.161969 Aug 04 21:49:15.817122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 390/789] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:15 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:49:16.212217 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-f3603539-fa95-43e5-8c90-8494ebe90aed req-df8c4613-a2ef-420e-a1a2-8b6fe021cd02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6a3daf-6b19-47d0-85ca-eed1eacb91ca", "name": "network-vif-plugged", "status": "completed", "tag": "0748a24c-fd32-415e-bade-f491bfffbd57"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:49:16.222172 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-f3603539-fa95-43e5-8c90-8494ebe90aed req-df8c4613-a2ef-420e-a1a2-8b6fe021cd02 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:16.222654 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-f3603539-fa95-43e5-8c90-8494ebe90aed req-df8c4613-a2ef-420e-a1a2-8b6fe021cd02 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:16.223076 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-f3603539-fa95-43e5-8c90-8494ebe90aed req-df8c4613-a2ef-420e-a1a2-8b6fe021cd02 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:16.234438 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-f3603539-fa95-43e5-8c90-8494ebe90aed req-df8c4613-a2ef-420e-a1a2-8b6fe021cd02 service nova] Creating event network-vif-plugged:0748a24c-fd32-415e-bade-f491bfffbd57 for instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca on hv-cinder-85220 Aug 04 21:49:16.239603 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-f3603539-fa95-43e5-8c90-8494ebe90aed req-df8c4613-a2ef-420e-a1a2-8b6fe021cd02 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031022 Aug 04 21:49:16.240203 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 400/790] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:49:16.840608 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e4b42a5f-3fc1-45a8-8473-3d48cbc920b4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:16.841462 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e4b42a5f-3fc1-45a8-8473-3d48cbc920b4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:16.849068 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e4b42a5f-3fc1-45a8-8473-3d48cbc920b4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:16.849672 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e4b42a5f-3fc1-45a8-8473-3d48cbc920b4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:16.850238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e4b42a5f-3fc1-45a8-8473-3d48cbc920b4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:16.851024 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e4b42a5f-3fc1-45a8-8473-3d48cbc920b4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:16.851552 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e4b42a5f-3fc1-45a8-8473-3d48cbc920b4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:16.852048 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e4b42a5f-3fc1-45a8-8473-3d48cbc920b4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:16.996931 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e4b42a5f-3fc1-45a8-8473-3d48cbc920b4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:17.006406 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e4b42a5f-3fc1-45a8-8473-3d48cbc920b4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:17.008220 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e4b42a5f-3fc1-45a8-8473-3d48cbc920b4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:17.009520 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e4b42a5f-3fc1-45a8-8473-3d48cbc920b4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1744 microversion: 2.20 time: 0.173547 Aug 04 21:49:17.010667 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 391/791] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:16 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:18.035350 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4b030856-d640-443b-b1a8-42b60ae9adb6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:18.038207 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4b030856-d640-443b-b1a8-42b60ae9adb6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:18.045305 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4b030856-d640-443b-b1a8-42b60ae9adb6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:18.045858 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4b030856-d640-443b-b1a8-42b60ae9adb6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:18.046263 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4b030856-d640-443b-b1a8-42b60ae9adb6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:18.046962 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4b030856-d640-443b-b1a8-42b60ae9adb6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:18.047413 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4b030856-d640-443b-b1a8-42b60ae9adb6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:18.051419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4b030856-d640-443b-b1a8-42b60ae9adb6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:18.380643 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4b030856-d640-443b-b1a8-42b60ae9adb6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:18.396889 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4b030856-d640-443b-b1a8-42b60ae9adb6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:18.399069 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4b030856-d640-443b-b1a8-42b60ae9adb6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:18.400462 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4b030856-d640-443b-b1a8-42b60ae9adb6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1739 microversion: 2.20 time: 0.369773 Aug 04 21:49:18.414800 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 401/792] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:18 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1739 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:19.425445 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-3c9355f2-5740-4f39-932d-659ff11906f9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:19.426243 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-3c9355f2-5740-4f39-932d-659ff11906f9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:19.435585 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3c9355f2-5740-4f39-932d-659ff11906f9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:19.436446 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3c9355f2-5740-4f39-932d-659ff11906f9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:19.437696 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3c9355f2-5740-4f39-932d-659ff11906f9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:19.439445 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3c9355f2-5740-4f39-932d-659ff11906f9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:19.440314 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3c9355f2-5740-4f39-932d-659ff11906f9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:19.441278 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3c9355f2-5740-4f39-932d-659ff11906f9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:19.675635 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-3c9355f2-5740-4f39-932d-659ff11906f9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:19.686375 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-3c9355f2-5740-4f39-932d-659ff11906f9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:19.688622 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-3c9355f2-5740-4f39-932d-659ff11906f9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:19.690622 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-3c9355f2-5740-4f39-932d-659ff11906f9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1739 microversion: 2.20 time: 0.268719 Aug 04 21:49:19.692617 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 392/793] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:19 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1739 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:20.722116 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-42458a7b-d867-4a11-91a7-6160437b2a05 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:20.722730 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-42458a7b-d867-4a11-91a7-6160437b2a05 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:20.739669 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-42458a7b-d867-4a11-91a7-6160437b2a05 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:20.740155 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-42458a7b-d867-4a11-91a7-6160437b2a05 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:20.740590 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-42458a7b-d867-4a11-91a7-6160437b2a05 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:20.741355 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-42458a7b-d867-4a11-91a7-6160437b2a05 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:20.744645 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-42458a7b-d867-4a11-91a7-6160437b2a05 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:20.744645 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-42458a7b-d867-4a11-91a7-6160437b2a05 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:20.752775 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-0abf31f2-8d18-4b8e-9455-4f03eab5db2b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:20.754339 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-0abf31f2-8d18-4b8e-9455-4f03eab5db2b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:20.763420 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0abf31f2-8d18-4b8e-9455-4f03eab5db2b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:20.764362 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0abf31f2-8d18-4b8e-9455-4f03eab5db2b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:20.765033 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0abf31f2-8d18-4b8e-9455-4f03eab5db2b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:20.765955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0abf31f2-8d18-4b8e-9455-4f03eab5db2b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:20.766680 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0abf31f2-8d18-4b8e-9455-4f03eab5db2b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:20.767318 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0abf31f2-8d18-4b8e-9455-4f03eab5db2b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:20.801313 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-0abf31f2-8d18-4b8e-9455-4f03eab5db2b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/ips" status: 200 len: 145 microversion: 2.1 time: 0.054253 Aug 04 21:49:20.802629 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 393/794] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 4 21:49:20 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/ips => generated 145 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:49:21.086455 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-42458a7b-d867-4a11-91a7-6160437b2a05 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:21.097356 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-42458a7b-d867-4a11-91a7-6160437b2a05 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:21.098977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-42458a7b-d867-4a11-91a7-6160437b2a05 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:21.100177 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-42458a7b-d867-4a11-91a7-6160437b2a05 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1739 microversion: 2.20 time: 0.384162 Aug 04 21:49:21.100734 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 402/795] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:20 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1739 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:22.126468 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-aa74e8a0-9689-4113-9864-0caeaed23113 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:22.127597 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-aa74e8a0-9689-4113-9864-0caeaed23113 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:22.142800 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aa74e8a0-9689-4113-9864-0caeaed23113 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:22.144569 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aa74e8a0-9689-4113-9864-0caeaed23113 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:22.144569 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aa74e8a0-9689-4113-9864-0caeaed23113 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:22.146254 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aa74e8a0-9689-4113-9864-0caeaed23113 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:22.147603 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aa74e8a0-9689-4113-9864-0caeaed23113 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:22.149142 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aa74e8a0-9689-4113-9864-0caeaed23113 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:22.334740 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-aa74e8a0-9689-4113-9864-0caeaed23113 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:22.344200 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-aa74e8a0-9689-4113-9864-0caeaed23113 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:22.345985 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-aa74e8a0-9689-4113-9864-0caeaed23113 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:22.347381 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-aa74e8a0-9689-4113-9864-0caeaed23113 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1739 microversion: 2.20 time: 0.226366 Aug 04 21:49:22.362507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 394/796] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:22 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:23.375086 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6af5c187-9f47-4fc9-b84b-0d6d5766361d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:23.376439 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-6af5c187-9f47-4fc9-b84b-0d6d5766361d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:23.391021 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6af5c187-9f47-4fc9-b84b-0d6d5766361d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:23.391781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6af5c187-9f47-4fc9-b84b-0d6d5766361d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:23.393325 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6af5c187-9f47-4fc9-b84b-0d6d5766361d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:23.394974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6af5c187-9f47-4fc9-b84b-0d6d5766361d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:23.396848 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6af5c187-9f47-4fc9-b84b-0d6d5766361d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:23.398765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6af5c187-9f47-4fc9-b84b-0d6d5766361d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:23.622471 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6af5c187-9f47-4fc9-b84b-0d6d5766361d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:23.634590 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6af5c187-9f47-4fc9-b84b-0d6d5766361d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:23.637246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6af5c187-9f47-4fc9-b84b-0d6d5766361d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:23.638941 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-6af5c187-9f47-4fc9-b84b-0d6d5766361d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1739 microversion: 2.20 time: 0.270808 Aug 04 21:49:23.663885 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 403/797] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:23 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1739 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:23.764365 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c3acb37a-81d8-46b0-baa4-aceaba4815fd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87056e3a-6828-4b71-9f54-db1093140111"}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:49:23.767461 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c3acb37a-81d8-46b0-baa4-aceaba4815fd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:23.782653 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c3acb37a-81d8-46b0-baa4-aceaba4815fd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:23.783451 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c3acb37a-81d8-46b0-baa4-aceaba4815fd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:23.784489 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c3acb37a-81d8-46b0-baa4-aceaba4815fd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:23.786894 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c3acb37a-81d8-46b0-baa4-aceaba4815fd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:23.787541 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c3acb37a-81d8-46b0-baa4-aceaba4815fd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:23.788613 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c3acb37a-81d8-46b0-baa4-aceaba4815fd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:23.922804 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:49:24.670418 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-0840bd2b-f09c-4746-ad5b-197e9b4c812d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:24.671659 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-0840bd2b-f09c-4746-ad5b-197e9b4c812d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:24.678829 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0840bd2b-f09c-4746-ad5b-197e9b4c812d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:24.680892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0840bd2b-f09c-4746-ad5b-197e9b4c812d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:24.682381 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0840bd2b-f09c-4746-ad5b-197e9b4c812d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:24.685060 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0840bd2b-f09c-4746-ad5b-197e9b4c812d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:24.685788 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0840bd2b-f09c-4746-ad5b-197e9b4c812d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:24.686922 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0840bd2b-f09c-4746-ad5b-197e9b4c812d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:24.701575 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c3acb37a-81d8-46b0-baa4-aceaba4815fd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "POST /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.941495 Aug 04 21:49:24.714171 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 395/798] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 4 21:49:23 2022] POST /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments => generated 194 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:49:24.970259 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0840bd2b-f09c-4746-ad5b-197e9b4c812d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:24.989285 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0840bd2b-f09c-4746-ad5b-197e9b4c812d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:24.992118 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0840bd2b-f09c-4746-ad5b-197e9b4c812d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:24.993887 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-0840bd2b-f09c-4746-ad5b-197e9b4c812d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1739 microversion: 2.20 time: 0.327630 Aug 04 21:49:25.016795 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 404/799] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:24 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1739 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:49:26.054115 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-abaea4a7-53ff-4edd-9f7a-8a1d8139eef6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:26.055630 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-abaea4a7-53ff-4edd-9f7a-8a1d8139eef6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:26.061790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=31 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:49:26.063995 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-abaea4a7-53ff-4edd-9f7a-8a1d8139eef6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:26.064721 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-abaea4a7-53ff-4edd-9f7a-8a1d8139eef6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:26.065372 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-abaea4a7-53ff-4edd-9f7a-8a1d8139eef6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:26.066397 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-abaea4a7-53ff-4edd-9f7a-8a1d8139eef6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:26.067104 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-abaea4a7-53ff-4edd-9f7a-8a1d8139eef6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:26.067968 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-abaea4a7-53ff-4edd-9f7a-8a1d8139eef6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:26.226871 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-abaea4a7-53ff-4edd-9f7a-8a1d8139eef6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:26.235617 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-abaea4a7-53ff-4edd-9f7a-8a1d8139eef6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:26.237098 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-abaea4a7-53ff-4edd-9f7a-8a1d8139eef6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:26.238304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-abaea4a7-53ff-4edd-9f7a-8a1d8139eef6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1739 microversion: 2.20 time: 0.219334 Aug 04 21:49:26.238907 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 396/800] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:26 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:27.262486 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8dc32b00-3963-4c53-8d3c-aa26e5354f47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:27.265107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8dc32b00-3963-4c53-8d3c-aa26e5354f47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:27.271915 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8dc32b00-3963-4c53-8d3c-aa26e5354f47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:27.272406 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8dc32b00-3963-4c53-8d3c-aa26e5354f47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:27.272841 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8dc32b00-3963-4c53-8d3c-aa26e5354f47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:27.275038 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8dc32b00-3963-4c53-8d3c-aa26e5354f47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:27.285664 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8dc32b00-3963-4c53-8d3c-aa26e5354f47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:27.285664 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8dc32b00-3963-4c53-8d3c-aa26e5354f47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:27.660305 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8dc32b00-3963-4c53-8d3c-aa26e5354f47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:27.675707 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8dc32b00-3963-4c53-8d3c-aa26e5354f47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:27.677533 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8dc32b00-3963-4c53-8d3c-aa26e5354f47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:27.681750 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8dc32b00-3963-4c53-8d3c-aa26e5354f47 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1739 microversion: 2.20 time: 0.422042 Aug 04 21:49:27.681750 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 405/801] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:27 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1739 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:28.714506 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-561e7671-0c35-4d43-8cb2-1b1baee80224 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:28.715890 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-561e7671-0c35-4d43-8cb2-1b1baee80224 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:28.723697 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-561e7671-0c35-4d43-8cb2-1b1baee80224 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:28.724507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-561e7671-0c35-4d43-8cb2-1b1baee80224 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:28.725246 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-561e7671-0c35-4d43-8cb2-1b1baee80224 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:28.726202 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-561e7671-0c35-4d43-8cb2-1b1baee80224 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:28.726868 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-561e7671-0c35-4d43-8cb2-1b1baee80224 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:28.727724 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-561e7671-0c35-4d43-8cb2-1b1baee80224 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:28.909000 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-561e7671-0c35-4d43-8cb2-1b1baee80224 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:28.923047 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-561e7671-0c35-4d43-8cb2-1b1baee80224 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:28.927514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-561e7671-0c35-4d43-8cb2-1b1baee80224 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:28.936268 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-561e7671-0c35-4d43-8cb2-1b1baee80224 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1739 microversion: 2.20 time: 0.227681 Aug 04 21:49:28.937695 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 397/802] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:28 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:29.966457 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4287f761-65ec-4137-b7d0-cb7c343fbdf9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:29.968920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4287f761-65ec-4137-b7d0-cb7c343fbdf9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:29.978035 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=33 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:49:29.980072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4287f761-65ec-4137-b7d0-cb7c343fbdf9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:29.980726 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4287f761-65ec-4137-b7d0-cb7c343fbdf9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:29.981501 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4287f761-65ec-4137-b7d0-cb7c343fbdf9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:29.982350 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4287f761-65ec-4137-b7d0-cb7c343fbdf9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:29.983950 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4287f761-65ec-4137-b7d0-cb7c343fbdf9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:29.984445 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4287f761-65ec-4137-b7d0-cb7c343fbdf9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:29.990864 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=91 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:49:30.287826 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4287f761-65ec-4137-b7d0-cb7c343fbdf9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:30.296910 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4287f761-65ec-4137-b7d0-cb7c343fbdf9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:30.298493 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4287f761-65ec-4137-b7d0-cb7c343fbdf9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:30.299654 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4287f761-65ec-4137-b7d0-cb7c343fbdf9 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1739 microversion: 2.20 time: 0.338941 Aug 04 21:49:30.300215 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 406/803] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:29 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1739 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:31.342532 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-6e97bee6-cf56-401e-9e7b-88770135dd5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:31.342532 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-6e97bee6-cf56-401e-9e7b-88770135dd5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:31.342532 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e97bee6-cf56-401e-9e7b-88770135dd5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:31.342532 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e97bee6-cf56-401e-9e7b-88770135dd5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:31.344978 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e97bee6-cf56-401e-9e7b-88770135dd5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:31.344978 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e97bee6-cf56-401e-9e7b-88770135dd5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:31.344978 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e97bee6-cf56-401e-9e7b-88770135dd5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:31.344978 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e97bee6-cf56-401e-9e7b-88770135dd5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:31.512278 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6e97bee6-cf56-401e-9e7b-88770135dd5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:31.521919 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6e97bee6-cf56-401e-9e7b-88770135dd5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:31.523554 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6e97bee6-cf56-401e-9e7b-88770135dd5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:31.525344 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-6e97bee6-cf56-401e-9e7b-88770135dd5c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1739 microversion: 2.20 time: 0.201759 Aug 04 21:49:31.526000 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 398/804] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:31 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:32.548654 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-27fae685-7b90-4ca6-a222-ff5b6bf8da9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:32.549921 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-27fae685-7b90-4ca6-a222-ff5b6bf8da9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:32.557596 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-27fae685-7b90-4ca6-a222-ff5b6bf8da9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:32.558109 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-27fae685-7b90-4ca6-a222-ff5b6bf8da9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:32.559918 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-27fae685-7b90-4ca6-a222-ff5b6bf8da9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:32.560814 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-27fae685-7b90-4ca6-a222-ff5b6bf8da9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:32.561431 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-27fae685-7b90-4ca6-a222-ff5b6bf8da9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:32.562236 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-27fae685-7b90-4ca6-a222-ff5b6bf8da9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:32.757950 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-27fae685-7b90-4ca6-a222-ff5b6bf8da9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:32.769337 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-27fae685-7b90-4ca6-a222-ff5b6bf8da9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:32.771177 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-27fae685-7b90-4ca6-a222-ff5b6bf8da9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:32.772562 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-27fae685-7b90-4ca6-a222-ff5b6bf8da9b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1739 microversion: 2.20 time: 0.227706 Aug 04 21:49:32.795334 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 407/805] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:32 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:33.646904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-7517ede8-fb0a-481b-ad9f-fc803ae9c99f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:33.649978 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-7517ede8-fb0a-481b-ad9f-fc803ae9c99f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:33.665896 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7517ede8-fb0a-481b-ad9f-fc803ae9c99f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:33.669832 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7517ede8-fb0a-481b-ad9f-fc803ae9c99f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:33.670178 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7517ede8-fb0a-481b-ad9f-fc803ae9c99f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:33.671147 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7517ede8-fb0a-481b-ad9f-fc803ae9c99f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:33.671735 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7517ede8-fb0a-481b-ad9f-fc803ae9c99f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:33.672971 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7517ede8-fb0a-481b-ad9f-fc803ae9c99f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:33.719552 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-7517ede8-fb0a-481b-ad9f-fc803ae9c99f tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078406 Aug 04 21:49:33.725537 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 399/806] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:49:33 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:49:33.731894 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4b731e44-d2d5-46c9-bc30-60cbe635cbb6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:33.732609 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4b731e44-d2d5-46c9-bc30-60cbe635cbb6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:33.743540 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4b731e44-d2d5-46c9-bc30-60cbe635cbb6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:33.744029 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4b731e44-d2d5-46c9-bc30-60cbe635cbb6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:33.744457 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4b731e44-d2d5-46c9-bc30-60cbe635cbb6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:33.750661 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4b731e44-d2d5-46c9-bc30-60cbe635cbb6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:33.750661 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4b731e44-d2d5-46c9-bc30-60cbe635cbb6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:33.750867 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4b731e44-d2d5-46c9-bc30-60cbe635cbb6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:33.788733 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4b731e44-d2d5-46c9-bc30-60cbe635cbb6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments/87056e3a-6828-4b71-9f54-db1093140111" status: 200 len: 194 microversion: 2.1 time: 0.061486 Aug 04 21:49:33.796996 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 408/807] 10.222.0.73 () {58 vars in 1413 bytes} [Thu Aug 4 21:49:33 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments/87056e3a-6828-4b71-9f54-db1093140111 => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:49:33.810433 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-cdcd8211-037f-4484-acab-cc0d788c9207 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:33.815577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-cdcd8211-037f-4484-acab-cc0d788c9207 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:33.835115 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cdcd8211-037f-4484-acab-cc0d788c9207 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:33.835613 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cdcd8211-037f-4484-acab-cc0d788c9207 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:33.836050 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cdcd8211-037f-4484-acab-cc0d788c9207 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:33.836756 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cdcd8211-037f-4484-acab-cc0d788c9207 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:33.844692 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cdcd8211-037f-4484-acab-cc0d788c9207 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:33.845291 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cdcd8211-037f-4484-acab-cc0d788c9207 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:34.106266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-cdcd8211-037f-4484-acab-cc0d788c9207 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:34.118680 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-cdcd8211-037f-4484-acab-cc0d788c9207 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:34.120587 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-cdcd8211-037f-4484-acab-cc0d788c9207 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:34.123309 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-cdcd8211-037f-4484-acab-cc0d788c9207 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1721 microversion: 2.20 time: 0.325794 Aug 04 21:49:34.139827 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 400/808] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:33 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1721 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:35.169833 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-86a37cee-b58c-42b1-8ada-226891de3db8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:35.170507 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-86a37cee-b58c-42b1-8ada-226891de3db8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:35.180032 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-86a37cee-b58c-42b1-8ada-226891de3db8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:35.180819 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-86a37cee-b58c-42b1-8ada-226891de3db8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:35.181418 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-86a37cee-b58c-42b1-8ada-226891de3db8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:35.182342 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-86a37cee-b58c-42b1-8ada-226891de3db8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:35.182951 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-86a37cee-b58c-42b1-8ada-226891de3db8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:35.183535 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-86a37cee-b58c-42b1-8ada-226891de3db8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:35.348731 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-86a37cee-b58c-42b1-8ada-226891de3db8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:35.357558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-86a37cee-b58c-42b1-8ada-226891de3db8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:35.359366 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-86a37cee-b58c-42b1-8ada-226891de3db8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:35.360958 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-86a37cee-b58c-42b1-8ada-226891de3db8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1721 microversion: 2.20 time: 0.196064 Aug 04 21:49:35.361692 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 409/809] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:35 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:36.388662 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-52aa2477-ddda-4e4b-bb1f-5aa7af0cc564 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:36.390798 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-52aa2477-ddda-4e4b-bb1f-5aa7af0cc564 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:36.395611 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-52aa2477-ddda-4e4b-bb1f-5aa7af0cc564 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:36.396390 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-52aa2477-ddda-4e4b-bb1f-5aa7af0cc564 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:36.397025 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-52aa2477-ddda-4e4b-bb1f-5aa7af0cc564 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:36.397916 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-52aa2477-ddda-4e4b-bb1f-5aa7af0cc564 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:36.398455 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-52aa2477-ddda-4e4b-bb1f-5aa7af0cc564 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:36.398964 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-52aa2477-ddda-4e4b-bb1f-5aa7af0cc564 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:36.562789 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-52aa2477-ddda-4e4b-bb1f-5aa7af0cc564 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:36.572717 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-52aa2477-ddda-4e4b-bb1f-5aa7af0cc564 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:36.574351 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-52aa2477-ddda-4e4b-bb1f-5aa7af0cc564 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:36.575603 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-52aa2477-ddda-4e4b-bb1f-5aa7af0cc564 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1721 microversion: 2.20 time: 0.191045 Aug 04 21:49:36.577487 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 401/810] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:36 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:36.691133 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2c6cbc66-2d22-484c-addf-1e935e630d17 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3addb1f-6263-4e6f-9938-ecdc19ee09cc"}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:49:36.694650 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2c6cbc66-2d22-484c-addf-1e935e630d17 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:36.705511 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2c6cbc66-2d22-484c-addf-1e935e630d17 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:36.706281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2c6cbc66-2d22-484c-addf-1e935e630d17 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:36.714352 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2c6cbc66-2d22-484c-addf-1e935e630d17 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:36.714352 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2c6cbc66-2d22-484c-addf-1e935e630d17 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:36.714352 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2c6cbc66-2d22-484c-addf-1e935e630d17 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:36.714352 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2c6cbc66-2d22-484c-addf-1e935e630d17 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:37.469104 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2c6cbc66-2d22-484c-addf-1e935e630d17 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "POST /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.781682 Aug 04 21:49:37.469868 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 410/811] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 4 21:49:36 2022] POST /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments => generated 194 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:49:37.602189 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-11667b66-50c7-4c02-8924-624c312e9e89 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:37.603716 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-11667b66-50c7-4c02-8924-624c312e9e89 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:37.623648 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-11667b66-50c7-4c02-8924-624c312e9e89 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:37.623648 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-11667b66-50c7-4c02-8924-624c312e9e89 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:37.623648 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-11667b66-50c7-4c02-8924-624c312e9e89 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:37.623648 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-11667b66-50c7-4c02-8924-624c312e9e89 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:37.623984 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-11667b66-50c7-4c02-8924-624c312e9e89 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:37.623984 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-11667b66-50c7-4c02-8924-624c312e9e89 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:37.797353 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-11667b66-50c7-4c02-8924-624c312e9e89 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:37.810475 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-11667b66-50c7-4c02-8924-624c312e9e89 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:37.812267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-11667b66-50c7-4c02-8924-624c312e9e89 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:37.814264 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-11667b66-50c7-4c02-8924-624c312e9e89 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1724 microversion: 2.20 time: 0.217056 Aug 04 21:49:37.830902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 402/812] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:37 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:37.843618 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f9ee5bac-ae8e-42e3-b0b5-1a444180974d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58fb3236-f094-4d30-83bb-e3cadd9df526"}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:49:37.846872 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-f9ee5bac-ae8e-42e3-b0b5-1a444180974d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:37.853766 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f9ee5bac-ae8e-42e3-b0b5-1a444180974d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:37.854515 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f9ee5bac-ae8e-42e3-b0b5-1a444180974d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:37.855115 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f9ee5bac-ae8e-42e3-b0b5-1a444180974d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:37.857071 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f9ee5bac-ae8e-42e3-b0b5-1a444180974d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:37.857698 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f9ee5bac-ae8e-42e3-b0b5-1a444180974d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:37.858336 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f9ee5bac-ae8e-42e3-b0b5-1a444180974d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:38.337029 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-fddb058d-f566-4902-aa8d-bb0fa0dc68f4 req-8d57bd1d-92ec-48c4-ba38-bf9796e8a43b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6a3daf-6b19-47d0-85ca-eed1eacb91ca", "name": "network-vif-unplugged", "status": "completed", "tag": "0748a24c-fd32-415e-bade-f491bfffbd57"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:49:38.347769 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-fddb058d-f566-4902-aa8d-bb0fa0dc68f4 req-8d57bd1d-92ec-48c4-ba38-bf9796e8a43b service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:38.348331 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-fddb058d-f566-4902-aa8d-bb0fa0dc68f4 req-8d57bd1d-92ec-48c4-ba38-bf9796e8a43b service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:38.348847 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-fddb058d-f566-4902-aa8d-bb0fa0dc68f4 req-8d57bd1d-92ec-48c4-ba38-bf9796e8a43b service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:38.363369 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.compute.server_external_events [req-fddb058d-f566-4902-aa8d-bb0fa0dc68f4 req-8d57bd1d-92ec-48c4-ba38-bf9796e8a43b service nova] Unable to find a host for instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca. Dropping event network-vif-unplugged {{(pid=136341) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 21:49:38.364717 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-fddb058d-f566-4902-aa8d-bb0fa0dc68f4 req-8d57bd1d-92ec-48c4-ba38-bf9796e8a43b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034299 Aug 04 21:49:38.365735 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 403/813] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 21:49:38.935811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-f9ee5bac-ae8e-42e3-b0b5-1a444180974d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "POST /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.100384 Aug 04 21:49:38.944102 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 411/814] 10.222.0.73 () {62 vars in 1364 bytes} [Thu Aug 4 21:49:37 2022] POST /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca/os-volume_attachments => generated 188 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:49:39.068850 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-af25eb46-3ddd-4b23-90ff-1bfe291ba87d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:39.069376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-af25eb46-3ddd-4b23-90ff-1bfe291ba87d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:39.076281 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-af25eb46-3ddd-4b23-90ff-1bfe291ba87d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:39.076756 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-af25eb46-3ddd-4b23-90ff-1bfe291ba87d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:39.077189 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-af25eb46-3ddd-4b23-90ff-1bfe291ba87d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:39.077879 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-af25eb46-3ddd-4b23-90ff-1bfe291ba87d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:39.078354 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-af25eb46-3ddd-4b23-90ff-1bfe291ba87d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:39.078775 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-af25eb46-3ddd-4b23-90ff-1bfe291ba87d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:39.906261 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-af25eb46-3ddd-4b23-90ff-1bfe291ba87d tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "DELETE /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca/os-volume_attachments/58fb3236-f094-4d30-83bb-e3cadd9df526" status: 202 len: 0 microversion: 2.20 time: 0.841221 Aug 04 21:49:39.910280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 404/815] 10.222.0.73 () {60 vars in 1457 bytes} [Thu Aug 4 21:49:39 2022] DELETE /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca/os-volume_attachments/58fb3236-f094-4d30-83bb-e3cadd9df526 => generated 0 bytes in 846 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:49:39.981646 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-35c45d0b-57d5-4832-8385-f94556ee8c04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:49:39.982307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-35c45d0b-57d5-4832-8385-f94556ee8c04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:39.988805 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-35c45d0b-57d5-4832-8385-f94556ee8c04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:39.989435 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-35c45d0b-57d5-4832-8385-f94556ee8c04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:39.989871 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-35c45d0b-57d5-4832-8385-f94556ee8c04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:39.990595 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-35c45d0b-57d5-4832-8385-f94556ee8c04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:39.991319 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-35c45d0b-57d5-4832-8385-f94556ee8c04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:39.991964 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-35c45d0b-57d5-4832-8385-f94556ee8c04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:40.041369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-35c45d0b-57d5-4832-8385-f94556ee8c04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=136342) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 21:49:40.344965 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-35c45d0b-57d5-4832-8385-f94556ee8c04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "POST /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca/action" status: 202 len: 0 microversion: 2.20 time: 0.367923 Aug 04 21:49:40.345469 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 412/816] 10.222.0.73 () {62 vars in 1319 bytes} [Thu Aug 4 21:49:39 2022] POST /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 04 21:49:40.354339 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f06437a9-16ff-4927-996a-32824000ece4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:40.361355 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-f06437a9-16ff-4927-996a-32824000ece4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:40.369532 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f06437a9-16ff-4927-996a-32824000ece4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:40.370534 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f06437a9-16ff-4927-996a-32824000ece4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:40.370981 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f06437a9-16ff-4927-996a-32824000ece4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:40.372656 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f06437a9-16ff-4927-996a-32824000ece4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:40.373119 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f06437a9-16ff-4927-996a-32824000ece4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:40.373536 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f06437a9-16ff-4927-996a-32824000ece4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:40.546375 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f06437a9-16ff-4927-996a-32824000ece4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:40.555566 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f06437a9-16ff-4927-996a-32824000ece4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:40.558427 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f06437a9-16ff-4927-996a-32824000ece4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:40.558546 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f06437a9-16ff-4927-996a-32824000ece4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1672 microversion: 2.20 time: 0.208645 Aug 04 21:49:40.574502 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 405/817] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:40 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1672 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:41.583025 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-fe3dd8f6-c70f-49cd-9682-7b89f8c0ec24 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:41.584300 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-fe3dd8f6-c70f-49cd-9682-7b89f8c0ec24 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:41.591251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fe3dd8f6-c70f-49cd-9682-7b89f8c0ec24 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:41.591724 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fe3dd8f6-c70f-49cd-9682-7b89f8c0ec24 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:41.592165 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fe3dd8f6-c70f-49cd-9682-7b89f8c0ec24 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:41.592865 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fe3dd8f6-c70f-49cd-9682-7b89f8c0ec24 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:41.593562 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fe3dd8f6-c70f-49cd-9682-7b89f8c0ec24 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:41.593990 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fe3dd8f6-c70f-49cd-9682-7b89f8c0ec24 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:41.740942 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-fe3dd8f6-c70f-49cd-9682-7b89f8c0ec24 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:41.753466 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-fe3dd8f6-c70f-49cd-9682-7b89f8c0ec24 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:41.755652 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-fe3dd8f6-c70f-49cd-9682-7b89f8c0ec24 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:41.757594 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-fe3dd8f6-c70f-49cd-9682-7b89f8c0ec24 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1672 microversion: 2.20 time: 0.177825 Aug 04 21:49:41.758608 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 413/818] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:41 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1672 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:42.784843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f009a0c5-93f2-499d-a1e7-eb27ca149db3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:42.784843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-f009a0c5-93f2-499d-a1e7-eb27ca149db3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:42.791819 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f009a0c5-93f2-499d-a1e7-eb27ca149db3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:42.796412 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f009a0c5-93f2-499d-a1e7-eb27ca149db3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:42.796412 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f009a0c5-93f2-499d-a1e7-eb27ca149db3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:42.796412 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f009a0c5-93f2-499d-a1e7-eb27ca149db3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:42.796412 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f009a0c5-93f2-499d-a1e7-eb27ca149db3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:42.796786 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f009a0c5-93f2-499d-a1e7-eb27ca149db3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:42.964774 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f009a0c5-93f2-499d-a1e7-eb27ca149db3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:42.977035 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f009a0c5-93f2-499d-a1e7-eb27ca149db3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:42.979643 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f009a0c5-93f2-499d-a1e7-eb27ca149db3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:42.980035 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f009a0c5-93f2-499d-a1e7-eb27ca149db3 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1674 microversion: 2.20 time: 0.199886 Aug 04 21:49:42.981008 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 406/819] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:42 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1674 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:43.785393 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e57356ec-8f55-4d31-9e12-4c19acf5214f tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Action: 'create', calling method: .version_select at 0x7f3c10f82280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1941403629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoKcTlPmjr1n5jVp2pldAomeF5GgHc2lJahri0qKtLGAMp14biZ5BfGRKmeDBMdIO71S+K6PnAyz1FASd9h21b9Y9XGoGi/a+izTACGjVL1BM/IX9dGvB/z7IznIgu0KQ=="}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:49:43.802029 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-e57356ec-8f55-4d31-9e12-4c19acf5214f tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Getting quotas for project b1685a61dd0844269efb39407dcd1e67. Resources: {'key_pairs'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:49:43.805872 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-e57356ec-8f55-4d31-9e12-4c19acf5214f tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Getting quotas for user 11ce89a0a9254498977b9ef531aa3b2e and project b1685a61dd0844269efb39407dcd1e67. Resources: {'key_pairs'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:49:43.908258 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e57356ec-8f55-4d31-9e12-4c19acf5214f tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.126769 Aug 04 21:49:43.908860 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 414/820] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 4 21:49:43 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:49:43.959875 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-036b2a07-7153-42e8-ade8-253c00a41811 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1691024846", "imageRef": "ca287607-7f9e-4bd5-b9c9-fa95683f433c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1941403629", "networks": [{"uuid": "07112ad5-d057-4986-838b-cc6cb07a235b"}]}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:49:44.011617 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b44e960a-90fa-4c77-8ced-633525bfdbff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:44.013017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b44e960a-90fa-4c77-8ced-633525bfdbff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:44.017223 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.network.neutron [None req-036b2a07-7153-42e8-ade8-253c00a41811 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] validate_networks() for [('07112ad5-d057-4986-838b-cc6cb07a235b', None, None, None, None, None)] {{(pid=136341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:49:44.019348 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b44e960a-90fa-4c77-8ced-633525bfdbff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:44.019830 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b44e960a-90fa-4c77-8ced-633525bfdbff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:44.020261 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b44e960a-90fa-4c77-8ced-633525bfdbff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:44.020951 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b44e960a-90fa-4c77-8ced-633525bfdbff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:44.021405 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b44e960a-90fa-4c77-8ced-633525bfdbff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:44.021824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b44e960a-90fa-4c77-8ced-633525bfdbff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:44.157843 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b44e960a-90fa-4c77-8ced-633525bfdbff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:44.166190 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b44e960a-90fa-4c77-8ced-633525bfdbff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:44.167684 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b44e960a-90fa-4c77-8ced-633525bfdbff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:44.169493 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b44e960a-90fa-4c77-8ced-633525bfdbff tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.162334 Aug 04 21:49:44.170065 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 415/821] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:44 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:49:44.400197 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-036b2a07-7153-42e8-ade8-253c00a41811 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Flavor limits 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:49:44.401326 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-036b2a07-7153-42e8-ade8-253c00a41811 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Image limits 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:49:44.401816 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-036b2a07-7153-42e8-ade8-253c00a41811 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Flavor pref 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:49:44.402541 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-036b2a07-7153-42e8-ade8-253c00a41811 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Image pref 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:49:44.403542 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-036b2a07-7153-42e8-ade8-253c00a41811 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:49:44.413299 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-036b2a07-7153-42e8-ade8-253c00a41811 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:44.413759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-036b2a07-7153-42e8-ade8-253c00a41811 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:44.414233 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-036b2a07-7153-42e8-ade8-253c00a41811 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:44.414960 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-036b2a07-7153-42e8-ade8-253c00a41811 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:44.415557 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-036b2a07-7153-42e8-ade8-253c00a41811 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:44.415877 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-036b2a07-7153-42e8-ade8-253c00a41811 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:44.434993 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-036b2a07-7153-42e8-ade8-253c00a41811 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Getting quotas for project b1685a61dd0844269efb39407dcd1e67. Resources: {'instances', 'cores', 'ram'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:49:44.439852 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-036b2a07-7153-42e8-ade8-253c00a41811 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Getting quotas for user 11ce89a0a9254498977b9ef531aa3b2e and project b1685a61dd0844269efb39407dcd1e67. Resources: {'instances', 'cores', 'ram'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:49:44.451839 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-036b2a07-7153-42e8-ade8-253c00a41811 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Going to run 1 instances... {{(pid=136341) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:49:44.454091 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-036b2a07-7153-42e8-ade8-253c00a41811 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca287607-7f9e-4bd5-b9c9-fa95683f433c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:49:44.611502 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-036b2a07-7153-42e8-ade8-253c00a41811 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655216 Aug 04 21:49:44.612066 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 407/822] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 4 21:49:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:49:44.624003 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6c20ddc6-8414-415b-8fb3-fdec2d42665f tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:44.624631 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-6c20ddc6-8414-415b-8fb3-fdec2d42665f tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:44.684476 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6c20ddc6-8414-415b-8fb3-fdec2d42665f tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:44.691122 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-6c20ddc6-8414-415b-8fb3-fdec2d42665f tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1259 microversion: 2.1 time: 0.071882 Aug 04 21:49:44.691693 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 416/823] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:49:44 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:49:45.192939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-4f260856-64b1-4610-9060-07b824654a4c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:45.193578 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-4f260856-64b1-4610-9060-07b824654a4c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:45.199743 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4f260856-64b1-4610-9060-07b824654a4c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:45.200412 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4f260856-64b1-4610-9060-07b824654a4c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:45.200855 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4f260856-64b1-4610-9060-07b824654a4c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:45.201571 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4f260856-64b1-4610-9060-07b824654a4c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:45.202067 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4f260856-64b1-4610-9060-07b824654a4c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:45.218453 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4f260856-64b1-4610-9060-07b824654a4c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:45.344970 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4f260856-64b1-4610-9060-07b824654a4c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:45.353359 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4f260856-64b1-4610-9060-07b824654a4c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:45.355065 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4f260856-64b1-4610-9060-07b824654a4c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:45.357195 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-4f260856-64b1-4610-9060-07b824654a4c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.168661 Aug 04 21:49:45.357822 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 408/824] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:45 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:45.713563 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-172479b5-9dbd-48c3-bd4e-081855a59ade tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:45.714255 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-172479b5-9dbd-48c3-bd4e-081855a59ade tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:45.773159 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-172479b5-9dbd-48c3-bd4e-081855a59ade tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:45.782981 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-172479b5-9dbd-48c3-bd4e-081855a59ade tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1259 microversion: 2.1 time: 0.074050 Aug 04 21:49:45.797303 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 417/825] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:49:45 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1259 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:49:46.223540 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-893bb338-84e9-4256-8546-aab2fb7d3fb9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:46.225797 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-893bb338-84e9-4256-8546-aab2fb7d3fb9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:46.233073 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-893bb338-84e9-4256-8546-aab2fb7d3fb9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:46.233584 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-893bb338-84e9-4256-8546-aab2fb7d3fb9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:46.234071 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-893bb338-84e9-4256-8546-aab2fb7d3fb9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:46.234797 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-893bb338-84e9-4256-8546-aab2fb7d3fb9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:46.235250 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-893bb338-84e9-4256-8546-aab2fb7d3fb9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:46.235890 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-893bb338-84e9-4256-8546-aab2fb7d3fb9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:46.276740 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-893bb338-84e9-4256-8546-aab2fb7d3fb9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057039 Aug 04 21:49:46.278240 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 409/826] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:49:46 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:49:46.381137 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-99d937e9-48c8-4e06-91b9-476da6f39321 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:46.383187 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-99d937e9-48c8-4e06-91b9-476da6f39321 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:46.390707 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-99d937e9-48c8-4e06-91b9-476da6f39321 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:46.391283 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-99d937e9-48c8-4e06-91b9-476da6f39321 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:46.391783 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-99d937e9-48c8-4e06-91b9-476da6f39321 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:46.392582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-99d937e9-48c8-4e06-91b9-476da6f39321 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:46.393031 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-99d937e9-48c8-4e06-91b9-476da6f39321 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:46.393446 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-99d937e9-48c8-4e06-91b9-476da6f39321 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:46.434801 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-25bc9ef1-9c46-44a8-8df3-434f105226ec tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:46.435523 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-25bc9ef1-9c46-44a8-8df3-434f105226ec tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:46.442719 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-25bc9ef1-9c46-44a8-8df3-434f105226ec tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:46.443721 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-25bc9ef1-9c46-44a8-8df3-434f105226ec tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:46.444457 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-25bc9ef1-9c46-44a8-8df3-434f105226ec tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:46.445382 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-25bc9ef1-9c46-44a8-8df3-434f105226ec tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:46.445893 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-25bc9ef1-9c46-44a8-8df3-434f105226ec tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:46.446401 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-25bc9ef1-9c46-44a8-8df3-434f105226ec tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:46.452596 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:49:46.498674 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-25bc9ef1-9c46-44a8-8df3-434f105226ec tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments/87056e3a-6828-4b71-9f54-db1093140111" status: 200 len: 194 microversion: 2.1 time: 0.068295 Aug 04 21:49:46.499881 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 410/827] 10.222.0.73 () {58 vars in 1413 bytes} [Thu Aug 4 21:49:46 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments/87056e3a-6828-4b71-9f54-db1093140111 => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:49:46.510592 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b003ea79-4030-40d4-aa24-fcc0c2c71edb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:46.511181 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b003ea79-4030-40d4-aa24-fcc0c2c71edb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:46.530442 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b003ea79-4030-40d4-aa24-fcc0c2c71edb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:46.531038 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b003ea79-4030-40d4-aa24-fcc0c2c71edb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:46.531543 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b003ea79-4030-40d4-aa24-fcc0c2c71edb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:46.532323 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b003ea79-4030-40d4-aa24-fcc0c2c71edb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:46.532844 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b003ea79-4030-40d4-aa24-fcc0c2c71edb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:46.533577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b003ea79-4030-40d4-aa24-fcc0c2c71edb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:46.551217 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-99d937e9-48c8-4e06-91b9-476da6f39321 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:46.560699 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-99d937e9-48c8-4e06-91b9-476da6f39321 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:46.562435 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-99d937e9-48c8-4e06-91b9-476da6f39321 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:46.563923 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-99d937e9-48c8-4e06-91b9-476da6f39321 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.186898 Aug 04 21:49:46.564556 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 418/828] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:46 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:46.656101 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.objects.instance [None req-b003ea79-4030-40d4-aa24-fcc0c2c71edb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lazy-loading 'services' on Instance uuid ce7b7159-6eae-4d5b-916c-43e4a21a6f60 {{(pid=136341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:49:46.804531 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-82f6c65e-a24e-4ab5-952a-12a715f98a7e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:46.805306 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-82f6c65e-a24e-4ab5-952a-12a715f98a7e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:46.814485 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-82f6c65e-a24e-4ab5-952a-12a715f98a7e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:46.814968 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-82f6c65e-a24e-4ab5-952a-12a715f98a7e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:46.815446 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-82f6c65e-a24e-4ab5-952a-12a715f98a7e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:46.816143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-82f6c65e-a24e-4ab5-952a-12a715f98a7e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:46.816590 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-82f6c65e-a24e-4ab5-952a-12a715f98a7e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:46.817005 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-82f6c65e-a24e-4ab5-952a-12a715f98a7e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:46.823340 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b003ea79-4030-40d4-aa24-fcc0c2c71edb tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments/87056e3a-6828-4b71-9f54-db1093140111" status: 202 len: 0 microversion: 2.1 time: 0.316418 Aug 04 21:49:46.824451 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 411/829] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 4 21:49:46 2022] DELETE /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments/87056e3a-6828-4b71-9f54-db1093140111 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:49:46.899411 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-82f6c65e-a24e-4ab5-952a-12a715f98a7e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:46.907872 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-82f6c65e-a24e-4ab5-952a-12a715f98a7e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1263 microversion: 2.1 time: 0.107238 Aug 04 21:49:46.916027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 419/830] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:49:46 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1263 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:49:47.589904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b2a8f598-4bd1-4b69-8cde-ad00d64c7053 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:47.591744 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b2a8f598-4bd1-4b69-8cde-ad00d64c7053 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:47.597442 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b2a8f598-4bd1-4b69-8cde-ad00d64c7053 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:47.597927 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b2a8f598-4bd1-4b69-8cde-ad00d64c7053 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:47.598381 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b2a8f598-4bd1-4b69-8cde-ad00d64c7053 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:47.599070 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b2a8f598-4bd1-4b69-8cde-ad00d64c7053 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:47.599513 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b2a8f598-4bd1-4b69-8cde-ad00d64c7053 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:47.599929 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b2a8f598-4bd1-4b69-8cde-ad00d64c7053 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:47.752889 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b2a8f598-4bd1-4b69-8cde-ad00d64c7053 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:47.761332 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b2a8f598-4bd1-4b69-8cde-ad00d64c7053 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:47.763367 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b2a8f598-4bd1-4b69-8cde-ad00d64c7053 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:47.764566 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b2a8f598-4bd1-4b69-8cde-ad00d64c7053 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.179623 Aug 04 21:49:47.765124 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 412/831] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:47 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:47.940403 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-22d2b327-2f24-46a7-96e5-58ccc053889b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:47.942725 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-22d2b327-2f24-46a7-96e5-58ccc053889b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:47.951629 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-22d2b327-2f24-46a7-96e5-58ccc053889b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:47.952773 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-22d2b327-2f24-46a7-96e5-58ccc053889b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:47.953713 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-22d2b327-2f24-46a7-96e5-58ccc053889b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:47.955138 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-22d2b327-2f24-46a7-96e5-58ccc053889b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:47.956120 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-22d2b327-2f24-46a7-96e5-58ccc053889b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:47.957098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-22d2b327-2f24-46a7-96e5-58ccc053889b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:48.036990 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-22d2b327-2f24-46a7-96e5-58ccc053889b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:48.039487 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:49:48.045951 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-22d2b327-2f24-46a7-96e5-58ccc053889b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1263 microversion: 2.1 time: 0.110136 Aug 04 21:49:48.051690 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 420/832] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:49:47 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1263 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:49:48.788312 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d2858dd8-bc64-49a5-9e1a-81b500d02a43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:48.789743 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-d2858dd8-bc64-49a5-9e1a-81b500d02a43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:48.796892 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d2858dd8-bc64-49a5-9e1a-81b500d02a43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:48.797461 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d2858dd8-bc64-49a5-9e1a-81b500d02a43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:48.797889 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d2858dd8-bc64-49a5-9e1a-81b500d02a43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:48.798606 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d2858dd8-bc64-49a5-9e1a-81b500d02a43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:48.799232 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d2858dd8-bc64-49a5-9e1a-81b500d02a43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:48.799696 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d2858dd8-bc64-49a5-9e1a-81b500d02a43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:48.952282 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d2858dd8-bc64-49a5-9e1a-81b500d02a43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:48.960536 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d2858dd8-bc64-49a5-9e1a-81b500d02a43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:48.962147 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d2858dd8-bc64-49a5-9e1a-81b500d02a43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:48.963309 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d2858dd8-bc64-49a5-9e1a-81b500d02a43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.179398 Aug 04 21:49:48.963865 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 413/833] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:48 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:49.068333 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b1ea3dfd-7a83-4fa3-8d69-761540640b8e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:49.069094 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b1ea3dfd-7a83-4fa3-8d69-761540640b8e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:49.083939 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b1ea3dfd-7a83-4fa3-8d69-761540640b8e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:49.084733 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b1ea3dfd-7a83-4fa3-8d69-761540640b8e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:49.085513 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b1ea3dfd-7a83-4fa3-8d69-761540640b8e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:49.086603 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b1ea3dfd-7a83-4fa3-8d69-761540640b8e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:49.087222 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b1ea3dfd-7a83-4fa3-8d69-761540640b8e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:49.088157 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b1ea3dfd-7a83-4fa3-8d69-761540640b8e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:49.158730 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b1ea3dfd-7a83-4fa3-8d69-761540640b8e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:49.166165 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b1ea3dfd-7a83-4fa3-8d69-761540640b8e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1263 microversion: 2.1 time: 0.103301 Aug 04 21:49:49.166719 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 421/834] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:49:49 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1263 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:49:49.989483 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e22a4a88-6416-4aa9-a453-acb61cf0116f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:49.990263 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e22a4a88-6416-4aa9-a453-acb61cf0116f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:49.998074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e22a4a88-6416-4aa9-a453-acb61cf0116f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:49.998668 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e22a4a88-6416-4aa9-a453-acb61cf0116f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:49.999101 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e22a4a88-6416-4aa9-a453-acb61cf0116f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:49.999798 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e22a4a88-6416-4aa9-a453-acb61cf0116f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:50.000243 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e22a4a88-6416-4aa9-a453-acb61cf0116f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:50.000656 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e22a4a88-6416-4aa9-a453-acb61cf0116f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:50.169674 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e22a4a88-6416-4aa9-a453-acb61cf0116f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:50.178134 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e22a4a88-6416-4aa9-a453-acb61cf0116f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:50.180755 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e22a4a88-6416-4aa9-a453-acb61cf0116f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:50.180908 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e22a4a88-6416-4aa9-a453-acb61cf0116f tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.196402 Aug 04 21:49:50.181398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 414/835] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:49 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:50.189576 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-66a08f40-8b4d-4c89-bb33-5f1902afdd69 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:50.191092 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-66a08f40-8b4d-4c89-bb33-5f1902afdd69 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:50.199141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-66a08f40-8b4d-4c89-bb33-5f1902afdd69 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:50.199674 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-66a08f40-8b4d-4c89-bb33-5f1902afdd69 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:50.200140 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-66a08f40-8b4d-4c89-bb33-5f1902afdd69 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:50.200980 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-66a08f40-8b4d-4c89-bb33-5f1902afdd69 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:50.201838 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-66a08f40-8b4d-4c89-bb33-5f1902afdd69 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:50.202323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-66a08f40-8b4d-4c89-bb33-5f1902afdd69 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:50.270901 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-66a08f40-8b4d-4c89-bb33-5f1902afdd69 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:50.280651 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-66a08f40-8b4d-4c89-bb33-5f1902afdd69 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1263 microversion: 2.1 time: 0.095020 Aug 04 21:49:50.281533 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 422/836] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:49:50 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1263 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:49:51.207505 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a5dfb2c6-9d24-42ac-a309-dc7b875c4002 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:51.208141 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a5dfb2c6-9d24-42ac-a309-dc7b875c4002 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:51.215077 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a5dfb2c6-9d24-42ac-a309-dc7b875c4002 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:51.215765 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a5dfb2c6-9d24-42ac-a309-dc7b875c4002 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:51.216203 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a5dfb2c6-9d24-42ac-a309-dc7b875c4002 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:51.216910 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a5dfb2c6-9d24-42ac-a309-dc7b875c4002 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:51.217359 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a5dfb2c6-9d24-42ac-a309-dc7b875c4002 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:51.217776 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a5dfb2c6-9d24-42ac-a309-dc7b875c4002 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:51.302437 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-de91f25e-9e6c-462b-991d-2c99fe9a0268 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:51.303161 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-de91f25e-9e6c-462b-991d-2c99fe9a0268 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:51.315328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-de91f25e-9e6c-462b-991d-2c99fe9a0268 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:51.316147 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-de91f25e-9e6c-462b-991d-2c99fe9a0268 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:51.316753 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-de91f25e-9e6c-462b-991d-2c99fe9a0268 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:51.317634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-de91f25e-9e6c-462b-991d-2c99fe9a0268 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:51.318425 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-de91f25e-9e6c-462b-991d-2c99fe9a0268 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:51.319125 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-de91f25e-9e6c-462b-991d-2c99fe9a0268 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:51.376089 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a5dfb2c6-9d24-42ac-a309-dc7b875c4002 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:51.384680 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a5dfb2c6-9d24-42ac-a309-dc7b875c4002 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:51.386735 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a5dfb2c6-9d24-42ac-a309-dc7b875c4002 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:51.388553 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a5dfb2c6-9d24-42ac-a309-dc7b875c4002 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.185812 Aug 04 21:49:51.389891 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 415/837] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:51 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:51.409588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-de91f25e-9e6c-462b-991d-2c99fe9a0268 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:51.419318 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-de91f25e-9e6c-462b-991d-2c99fe9a0268 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1263 microversion: 2.1 time: 0.120183 Aug 04 21:49:51.420464 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 423/838] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:49:51 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1263 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:49:52.412870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-79315f3f-2b64-4e82-bc95-7db517d67a01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:52.414408 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-79315f3f-2b64-4e82-bc95-7db517d67a01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:52.422849 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-79315f3f-2b64-4e82-bc95-7db517d67a01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:52.423472 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-79315f3f-2b64-4e82-bc95-7db517d67a01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:52.424028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-79315f3f-2b64-4e82-bc95-7db517d67a01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:52.424797 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-79315f3f-2b64-4e82-bc95-7db517d67a01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:52.425247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-79315f3f-2b64-4e82-bc95-7db517d67a01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:52.425687 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-79315f3f-2b64-4e82-bc95-7db517d67a01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:52.441985 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a1c0209a-3f73-4646-ad6c-cf3c8ac3ebff tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:52.442607 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-a1c0209a-3f73-4646-ad6c-cf3c8ac3ebff tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:52.451472 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a1c0209a-3f73-4646-ad6c-cf3c8ac3ebff tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:52.452699 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a1c0209a-3f73-4646-ad6c-cf3c8ac3ebff tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:52.452699 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a1c0209a-3f73-4646-ad6c-cf3c8ac3ebff tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:52.453338 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a1c0209a-3f73-4646-ad6c-cf3c8ac3ebff tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:52.453801 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a1c0209a-3f73-4646-ad6c-cf3c8ac3ebff tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:52.454396 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a1c0209a-3f73-4646-ad6c-cf3c8ac3ebff tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:52.544823 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-a1c0209a-3f73-4646-ad6c-cf3c8ac3ebff tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:52.553634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-a1c0209a-3f73-4646-ad6c-cf3c8ac3ebff tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1263 microversion: 2.1 time: 0.115794 Aug 04 21:49:52.554816 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 424/839] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:49:52 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1263 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:49:52.624629 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-79315f3f-2b64-4e82-bc95-7db517d67a01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:52.633143 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-79315f3f-2b64-4e82-bc95-7db517d67a01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:52.634959 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-79315f3f-2b64-4e82-bc95-7db517d67a01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:52.636413 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-79315f3f-2b64-4e82-bc95-7db517d67a01 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.227560 Aug 04 21:49:52.638672 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 416/840] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:52 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:53.579663 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-db0e5eeb-76c0-4125-aa33-3ea1a7e3b9a2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:53.580268 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-db0e5eeb-76c0-4125-aa33-3ea1a7e3b9a2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:53.586583 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-db0e5eeb-76c0-4125-aa33-3ea1a7e3b9a2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:53.587065 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-db0e5eeb-76c0-4125-aa33-3ea1a7e3b9a2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:53.587495 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-db0e5eeb-76c0-4125-aa33-3ea1a7e3b9a2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:53.588176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-db0e5eeb-76c0-4125-aa33-3ea1a7e3b9a2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:53.588634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-db0e5eeb-76c0-4125-aa33-3ea1a7e3b9a2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:53.589053 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-db0e5eeb-76c0-4125-aa33-3ea1a7e3b9a2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:53.649695 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-db0e5eeb-76c0-4125-aa33-3ea1a7e3b9a2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:53.657178 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-db0e5eeb-76c0-4125-aa33-3ea1a7e3b9a2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1263 microversion: 2.1 time: 0.081436 Aug 04 21:49:53.657745 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 425/841] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:49:53 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:49:53.663219 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a0d1be4a-66bf-4dcd-b748-83496b532c67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:53.663821 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a0d1be4a-66bf-4dcd-b748-83496b532c67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:53.670618 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0d1be4a-66bf-4dcd-b748-83496b532c67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:53.671092 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0d1be4a-66bf-4dcd-b748-83496b532c67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:53.671517 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0d1be4a-66bf-4dcd-b748-83496b532c67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:53.672200 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0d1be4a-66bf-4dcd-b748-83496b532c67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:53.672640 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0d1be4a-66bf-4dcd-b748-83496b532c67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:53.673053 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0d1be4a-66bf-4dcd-b748-83496b532c67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:53.801817 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a0d1be4a-66bf-4dcd-b748-83496b532c67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:53.810662 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a0d1be4a-66bf-4dcd-b748-83496b532c67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:53.812275 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a0d1be4a-66bf-4dcd-b748-83496b532c67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:53.813470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a0d1be4a-66bf-4dcd-b748-83496b532c67 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.154137 Aug 04 21:49:53.814044 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 417/842] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:53 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:54.677764 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b17c8b8f-1d2a-4a6c-8b36-a762052253d2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:54.678317 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b17c8b8f-1d2a-4a6c-8b36-a762052253d2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:54.685411 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b17c8b8f-1d2a-4a6c-8b36-a762052253d2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:54.685889 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b17c8b8f-1d2a-4a6c-8b36-a762052253d2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:54.686362 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b17c8b8f-1d2a-4a6c-8b36-a762052253d2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:54.687049 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b17c8b8f-1d2a-4a6c-8b36-a762052253d2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:54.687505 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b17c8b8f-1d2a-4a6c-8b36-a762052253d2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:54.687965 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b17c8b8f-1d2a-4a6c-8b36-a762052253d2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:54.748241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b17c8b8f-1d2a-4a6c-8b36-a762052253d2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:54.755600 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b17c8b8f-1d2a-4a6c-8b36-a762052253d2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1263 microversion: 2.1 time: 0.081793 Aug 04 21:49:54.756185 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 426/843] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:49:54 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:49:54.835555 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-81da19dd-80c3-495d-a92a-9157687081df tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:54.836159 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-81da19dd-80c3-495d-a92a-9157687081df tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:54.838161 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=2 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:49:54.838841 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=6 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:49:54.844134 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-81da19dd-80c3-495d-a92a-9157687081df tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:54.851701 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-81da19dd-80c3-495d-a92a-9157687081df tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:54.851701 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-81da19dd-80c3-495d-a92a-9157687081df tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:54.851701 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-81da19dd-80c3-495d-a92a-9157687081df tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:54.851701 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-81da19dd-80c3-495d-a92a-9157687081df tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:54.852100 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-81da19dd-80c3-495d-a92a-9157687081df tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:54.975717 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-81da19dd-80c3-495d-a92a-9157687081df tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:54.984314 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-81da19dd-80c3-495d-a92a-9157687081df tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:54.985809 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-81da19dd-80c3-495d-a92a-9157687081df tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:54.987000 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-81da19dd-80c3-495d-a92a-9157687081df tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.155362 Aug 04 21:49:54.987554 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 418/844] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:54 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:55.775145 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e4ff8fea-e33f-496e-a5d7-550b36e3c33c tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:55.775757 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e4ff8fea-e33f-496e-a5d7-550b36e3c33c tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:55.782323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e4ff8fea-e33f-496e-a5d7-550b36e3c33c tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:55.782803 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e4ff8fea-e33f-496e-a5d7-550b36e3c33c tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:55.783235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e4ff8fea-e33f-496e-a5d7-550b36e3c33c tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:55.783918 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e4ff8fea-e33f-496e-a5d7-550b36e3c33c tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:55.784383 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e4ff8fea-e33f-496e-a5d7-550b36e3c33c tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:55.784807 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e4ff8fea-e33f-496e-a5d7-550b36e3c33c tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:55.785238 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=8 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:49:55.854317 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e4ff8fea-e33f-496e-a5d7-550b36e3c33c tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:55.859665 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e4ff8fea-e33f-496e-a5d7-550b36e3c33c tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1263 microversion: 2.1 time: 0.088337 Aug 04 21:49:55.860263 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 427/845] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:49:55 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1263 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:49:56.009848 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-480fc283-b5ae-40db-9bfe-a05494915380 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:56.010559 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-480fc283-b5ae-40db-9bfe-a05494915380 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:56.017316 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-480fc283-b5ae-40db-9bfe-a05494915380 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:56.017795 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-480fc283-b5ae-40db-9bfe-a05494915380 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:56.018353 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-480fc283-b5ae-40db-9bfe-a05494915380 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:56.019076 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-480fc283-b5ae-40db-9bfe-a05494915380 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:56.019523 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-480fc283-b5ae-40db-9bfe-a05494915380 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:56.019992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-480fc283-b5ae-40db-9bfe-a05494915380 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:56.155460 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-480fc283-b5ae-40db-9bfe-a05494915380 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:56.163441 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-480fc283-b5ae-40db-9bfe-a05494915380 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:56.164934 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-480fc283-b5ae-40db-9bfe-a05494915380 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:56.166097 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-480fc283-b5ae-40db-9bfe-a05494915380 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.160359 Aug 04 21:49:56.166656 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 419/846] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:56 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:56.880903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-0fe659a8-9509-4b1d-a278-97d17e2aac52 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:56.881453 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-0fe659a8-9509-4b1d-a278-97d17e2aac52 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:56.887943 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0fe659a8-9509-4b1d-a278-97d17e2aac52 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:56.889012 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0fe659a8-9509-4b1d-a278-97d17e2aac52 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:56.889671 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0fe659a8-9509-4b1d-a278-97d17e2aac52 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:56.890394 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0fe659a8-9509-4b1d-a278-97d17e2aac52 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:56.890840 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0fe659a8-9509-4b1d-a278-97d17e2aac52 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:56.891284 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0fe659a8-9509-4b1d-a278-97d17e2aac52 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:56.953951 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0fe659a8-9509-4b1d-a278-97d17e2aac52 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:56.961329 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-0fe659a8-9509-4b1d-a278-97d17e2aac52 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1263 microversion: 2.1 time: 0.084366 Aug 04 21:49:56.961888 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 428/847] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:49:56 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1263 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:49:57.189249 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-946fe471-e6cf-4ebf-98b4-a2a0f207796b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:57.189852 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-946fe471-e6cf-4ebf-98b4-a2a0f207796b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:57.196258 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-946fe471-e6cf-4ebf-98b4-a2a0f207796b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:57.196732 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-946fe471-e6cf-4ebf-98b4-a2a0f207796b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:57.197163 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-946fe471-e6cf-4ebf-98b4-a2a0f207796b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:57.197845 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-946fe471-e6cf-4ebf-98b4-a2a0f207796b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:57.198320 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-946fe471-e6cf-4ebf-98b4-a2a0f207796b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:57.198744 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-946fe471-e6cf-4ebf-98b4-a2a0f207796b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:57.331756 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-946fe471-e6cf-4ebf-98b4-a2a0f207796b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:57.339611 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-946fe471-e6cf-4ebf-98b4-a2a0f207796b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:57.341104 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-946fe471-e6cf-4ebf-98b4-a2a0f207796b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:57.342418 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-946fe471-e6cf-4ebf-98b4-a2a0f207796b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.157626 Aug 04 21:49:57.342975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 420/848] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:57 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:57.984034 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a0093345-fa86-4da8-bfc4-7848e94a8d83 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:57.984034 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-a0093345-fa86-4da8-bfc4-7848e94a8d83 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:57.990311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a0093345-fa86-4da8-bfc4-7848e94a8d83 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:57.990821 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a0093345-fa86-4da8-bfc4-7848e94a8d83 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:57.991261 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a0093345-fa86-4da8-bfc4-7848e94a8d83 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:57.991965 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a0093345-fa86-4da8-bfc4-7848e94a8d83 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:57.992413 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a0093345-fa86-4da8-bfc4-7848e94a8d83 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:57.992838 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a0093345-fa86-4da8-bfc4-7848e94a8d83 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:58.058886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-a0093345-fa86-4da8-bfc4-7848e94a8d83 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:58.066376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-a0093345-fa86-4da8-bfc4-7848e94a8d83 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1263 microversion: 2.1 time: 0.088099 Aug 04 21:49:58.069854 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 429/849] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:49:57 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1263 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:49:58.364571 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-28fd7bb5-8724-49a2-b434-1716a14933d6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:58.365172 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-28fd7bb5-8724-49a2-b434-1716a14933d6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:58.371836 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-28fd7bb5-8724-49a2-b434-1716a14933d6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:58.372566 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-28fd7bb5-8724-49a2-b434-1716a14933d6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:58.372995 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-28fd7bb5-8724-49a2-b434-1716a14933d6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:58.373678 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-28fd7bb5-8724-49a2-b434-1716a14933d6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:58.374158 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-28fd7bb5-8724-49a2-b434-1716a14933d6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:58.374576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-28fd7bb5-8724-49a2-b434-1716a14933d6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:58.658504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-28fd7bb5-8724-49a2-b434-1716a14933d6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:58.666383 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-28fd7bb5-8724-49a2-b434-1716a14933d6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:58.667889 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-28fd7bb5-8724-49a2-b434-1716a14933d6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:58.669038 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-28fd7bb5-8724-49a2-b434-1716a14933d6 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.308385 Aug 04 21:49:58.669614 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 421/850] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:58 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:49:59.088461 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ca82e467-95ce-47ca-acd5-670aab227084 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:59.089505 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ca82e467-95ce-47ca-acd5-670aab227084 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:59.096633 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ca82e467-95ce-47ca-acd5-670aab227084 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:59.097116 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ca82e467-95ce-47ca-acd5-670aab227084 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:59.097550 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ca82e467-95ce-47ca-acd5-670aab227084 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:59.098272 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ca82e467-95ce-47ca-acd5-670aab227084 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:59.098727 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ca82e467-95ce-47ca-acd5-670aab227084 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:59.099148 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ca82e467-95ce-47ca-acd5-670aab227084 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:59.161106 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ca82e467-95ce-47ca-acd5-670aab227084 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:59.168484 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ca82e467-95ce-47ca-acd5-670aab227084 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1311 microversion: 2.1 time: 0.085299 Aug 04 21:49:59.169046 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 430/851] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:49:59 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1311 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:49:59.681023 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e69dd75d-e381-4d87-b051-f0e175ad6554 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:59.681676 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e69dd75d-e381-4d87-b051-f0e175ad6554 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:59.684060 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:49:59.692718 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-34bdd5e3-8639-45ea-b274-1cdb2d44c9f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:59.693331 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-34bdd5e3-8639-45ea-b274-1cdb2d44c9f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:59.697728 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e69dd75d-e381-4d87-b051-f0e175ad6554 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:59.698302 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e69dd75d-e381-4d87-b051-f0e175ad6554 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:59.698955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e69dd75d-e381-4d87-b051-f0e175ad6554 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:59.699137 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-34bdd5e3-8639-45ea-b274-1cdb2d44c9f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:59.699621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-34bdd5e3-8639-45ea-b274-1cdb2d44c9f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:59.699735 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e69dd75d-e381-4d87-b051-f0e175ad6554 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:59.700056 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-34bdd5e3-8639-45ea-b274-1cdb2d44c9f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:59.700179 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e69dd75d-e381-4d87-b051-f0e175ad6554 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:59.700490 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e69dd75d-e381-4d87-b051-f0e175ad6554 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:59.700742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-34bdd5e3-8639-45ea-b274-1cdb2d44c9f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:59.701192 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-34bdd5e3-8639-45ea-b274-1cdb2d44c9f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:59.701613 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-34bdd5e3-8639-45ea-b274-1cdb2d44c9f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:59.732461 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e69dd75d-e381-4d87-b051-f0e175ad6554 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments/d3addb1f-6263-4e6f-9938-ecdc19ee09cc" status: 200 len: 194 microversion: 2.1 time: 0.055238 Aug 04 21:49:59.732920 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 422/852] 10.222.0.73 () {58 vars in 1413 bytes} [Thu Aug 4 21:49:59 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments/d3addb1f-6263-4e6f-9938-ecdc19ee09cc => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:49:59.743356 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-22944433-0826-45c9-8c5b-d600829304d2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:49:59.743838 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-22944433-0826-45c9-8c5b-d600829304d2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:49:59.750050 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-22944433-0826-45c9-8c5b-d600829304d2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:59.750564 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-22944433-0826-45c9-8c5b-d600829304d2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:59.750992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-22944433-0826-45c9-8c5b-d600829304d2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:59.751694 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-22944433-0826-45c9-8c5b-d600829304d2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:49:59.752138 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-22944433-0826-45c9-8c5b-d600829304d2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:49:59.752551 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-22944433-0826-45c9-8c5b-d600829304d2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:49:59.839489 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.objects.instance [None req-22944433-0826-45c9-8c5b-d600829304d2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lazy-loading 'services' on Instance uuid ce7b7159-6eae-4d5b-916c-43e4a21a6f60 {{(pid=136341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:49:59.932398 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-34bdd5e3-8639-45ea-b274-1cdb2d44c9f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:59.942364 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-34bdd5e3-8639-45ea-b274-1cdb2d44c9f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:59.944402 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-34bdd5e3-8639-45ea-b274-1cdb2d44c9f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:49:59.945575 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-34bdd5e3-8639-45ea-b274-1cdb2d44c9f0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.256702 Aug 04 21:49:59.946459 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 431/853] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:49:59 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:50:00.047262 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-22944433-0826-45c9-8c5b-d600829304d2 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments/d3addb1f-6263-4e6f-9938-ecdc19ee09cc" status: 202 len: 0 microversion: 2.1 time: 0.305178 Aug 04 21:50:00.047262 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 423/854] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 4 21:49:59 2022] DELETE /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments/d3addb1f-6263-4e6f-9938-ecdc19ee09cc => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 21:50:00.191021 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-fff27db7-0d75-4616-acb0-3f6ae2d6a0fd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:00.191708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-fff27db7-0d75-4616-acb0-3f6ae2d6a0fd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:00.195076 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:50:00.198772 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fff27db7-0d75-4616-acb0-3f6ae2d6a0fd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:00.199547 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fff27db7-0d75-4616-acb0-3f6ae2d6a0fd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:00.200195 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fff27db7-0d75-4616-acb0-3f6ae2d6a0fd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:00.201244 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fff27db7-0d75-4616-acb0-3f6ae2d6a0fd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:00.201921 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fff27db7-0d75-4616-acb0-3f6ae2d6a0fd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:00.203343 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fff27db7-0d75-4616-acb0-3f6ae2d6a0fd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:00.478902 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-fff27db7-0d75-4616-acb0-3f6ae2d6a0fd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:00.489456 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-fff27db7-0d75-4616-acb0-3f6ae2d6a0fd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1359 microversion: 2.1 time: 0.303210 Aug 04 21:50:00.494498 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 432/855] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:00 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1359 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:00.973002 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-7fa4013f-7d2e-40fd-b513-fa3b1b674c6b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:00.974439 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-7fa4013f-7d2e-40fd-b513-fa3b1b674c6b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:00.980862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7fa4013f-7d2e-40fd-b513-fa3b1b674c6b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:00.981348 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7fa4013f-7d2e-40fd-b513-fa3b1b674c6b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:00.981779 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7fa4013f-7d2e-40fd-b513-fa3b1b674c6b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:00.982516 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7fa4013f-7d2e-40fd-b513-fa3b1b674c6b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:00.983096 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7fa4013f-7d2e-40fd-b513-fa3b1b674c6b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:00.983380 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-7fa4013f-7d2e-40fd-b513-fa3b1b674c6b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:01.180175 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-7fa4013f-7d2e-40fd-b513-fa3b1b674c6b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:01.190942 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-7fa4013f-7d2e-40fd-b513-fa3b1b674c6b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:01.193132 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-7fa4013f-7d2e-40fd-b513-fa3b1b674c6b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:01.195016 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-7fa4013f-7d2e-40fd-b513-fa3b1b674c6b tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.227459 Aug 04 21:50:01.195842 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 424/856] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:50:00 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:50:01.511586 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ed68bb20-fcc0-4edd-87c9-a69919ff44a6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:01.512205 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ed68bb20-fcc0-4edd-87c9-a69919ff44a6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:01.519478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ed68bb20-fcc0-4edd-87c9-a69919ff44a6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:01.522582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ed68bb20-fcc0-4edd-87c9-a69919ff44a6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:01.522582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ed68bb20-fcc0-4edd-87c9-a69919ff44a6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:01.522582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ed68bb20-fcc0-4edd-87c9-a69919ff44a6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:01.522582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ed68bb20-fcc0-4edd-87c9-a69919ff44a6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:01.522949 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ed68bb20-fcc0-4edd-87c9-a69919ff44a6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:01.742659 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ed68bb20-fcc0-4edd-87c9-a69919ff44a6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:01.742659 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ed68bb20-fcc0-4edd-87c9-a69919ff44a6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1359 microversion: 2.1 time: 0.176790 Aug 04 21:50:01.742659 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 433/857] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:01 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:02.226982 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-5e291fa3-afcd-4f0c-b6ca-a8c291a1a86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:02.227638 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-5e291fa3-afcd-4f0c-b6ca-a8c291a1a86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:02.237480 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5e291fa3-afcd-4f0c-b6ca-a8c291a1a86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:02.237480 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5e291fa3-afcd-4f0c-b6ca-a8c291a1a86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:02.237480 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5e291fa3-afcd-4f0c-b6ca-a8c291a1a86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:02.237480 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5e291fa3-afcd-4f0c-b6ca-a8c291a1a86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:02.237990 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5e291fa3-afcd-4f0c-b6ca-a8c291a1a86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:02.237990 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5e291fa3-afcd-4f0c-b6ca-a8c291a1a86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:02.261950 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:50:02.402203 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5e291fa3-afcd-4f0c-b6ca-a8c291a1a86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:02.412425 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5e291fa3-afcd-4f0c-b6ca-a8c291a1a86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:02.414177 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5e291fa3-afcd-4f0c-b6ca-a8c291a1a86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:02.415961 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-5e291fa3-afcd-4f0c-b6ca-a8c291a1a86c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.200104 Aug 04 21:50:02.426113 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 425/858] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:50:02 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:50:02.535136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-718a72b9-d00d-40f5-9c33-e7f45f5c20fe req-0fd57fd2-7ac2-4dad-86c1-ed6cdb8a815d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6a3daf-6b19-47d0-85ca-eed1eacb91ca", "name": "network-vif-plugged", "status": "completed", "tag": "0748a24c-fd32-415e-bade-f491bfffbd57"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:50:02.545118 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-718a72b9-d00d-40f5-9c33-e7f45f5c20fe req-0fd57fd2-7ac2-4dad-86c1-ed6cdb8a815d service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:02.545599 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-718a72b9-d00d-40f5-9c33-e7f45f5c20fe req-0fd57fd2-7ac2-4dad-86c1-ed6cdb8a815d service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:02.546049 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-718a72b9-d00d-40f5-9c33-e7f45f5c20fe req-0fd57fd2-7ac2-4dad-86c1-ed6cdb8a815d service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:02.558137 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-718a72b9-d00d-40f5-9c33-e7f45f5c20fe req-0fd57fd2-7ac2-4dad-86c1-ed6cdb8a815d service nova] Creating event network-vif-plugged:0748a24c-fd32-415e-bade-f491bfffbd57 for instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca on hv-cinder-85220 Aug 04 21:50:02.563880 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-718a72b9-d00d-40f5-9c33-e7f45f5c20fe req-0fd57fd2-7ac2-4dad-86c1-ed6cdb8a815d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033306 Aug 04 21:50:02.564690 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 434/859] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:50:02.706046 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c36f23d8-928d-4199-ba50-bcce42d9b844 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:02.706618 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c36f23d8-928d-4199-ba50-bcce42d9b844 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:02.712624 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c36f23d8-928d-4199-ba50-bcce42d9b844 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:02.713106 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c36f23d8-928d-4199-ba50-bcce42d9b844 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:02.713541 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c36f23d8-928d-4199-ba50-bcce42d9b844 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:02.714249 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c36f23d8-928d-4199-ba50-bcce42d9b844 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:02.714690 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c36f23d8-928d-4199-ba50-bcce42d9b844 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:02.715104 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c36f23d8-928d-4199-ba50-bcce42d9b844 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:02.860509 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-c36f23d8-928d-4199-ba50-bcce42d9b844 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:02.869757 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c36f23d8-928d-4199-ba50-bcce42d9b844 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1359 microversion: 2.1 time: 0.168174 Aug 04 21:50:02.870375 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 426/860] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:02 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:03.445436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b7da11ad-b5bc-40eb-aafa-c9976255092e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:03.446151 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b7da11ad-b5bc-40eb-aafa-c9976255092e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:03.455361 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b7da11ad-b5bc-40eb-aafa-c9976255092e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:03.456063 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b7da11ad-b5bc-40eb-aafa-c9976255092e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:03.456527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b7da11ad-b5bc-40eb-aafa-c9976255092e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:03.457237 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b7da11ad-b5bc-40eb-aafa-c9976255092e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:03.457716 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b7da11ad-b5bc-40eb-aafa-c9976255092e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:03.458198 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b7da11ad-b5bc-40eb-aafa-c9976255092e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:03.616680 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b7da11ad-b5bc-40eb-aafa-c9976255092e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:03.625881 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b7da11ad-b5bc-40eb-aafa-c9976255092e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:03.627442 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b7da11ad-b5bc-40eb-aafa-c9976255092e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:03.628583 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b7da11ad-b5bc-40eb-aafa-c9976255092e tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.187622 Aug 04 21:50:03.629137 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 435/861] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:50:03 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:50:03.891548 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-9a9bdbb1-0b78-4e77-8e80-a6facc0335d6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:03.892206 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-9a9bdbb1-0b78-4e77-8e80-a6facc0335d6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:03.898661 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a9bdbb1-0b78-4e77-8e80-a6facc0335d6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:03.899175 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a9bdbb1-0b78-4e77-8e80-a6facc0335d6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:03.899608 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a9bdbb1-0b78-4e77-8e80-a6facc0335d6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:03.900302 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a9bdbb1-0b78-4e77-8e80-a6facc0335d6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:03.900751 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a9bdbb1-0b78-4e77-8e80-a6facc0335d6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:03.901168 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9a9bdbb1-0b78-4e77-8e80-a6facc0335d6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:04.036027 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-9a9bdbb1-0b78-4e77-8e80-a6facc0335d6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:04.043719 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-9a9bdbb1-0b78-4e77-8e80-a6facc0335d6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1359 microversion: 2.1 time: 0.156757 Aug 04 21:50:04.045149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 427/862] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:03 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:04.652753 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ead107e8-295a-427e-9d49-af1347bd88bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:04.654304 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ead107e8-295a-427e-9d49-af1347bd88bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:04.661996 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ead107e8-295a-427e-9d49-af1347bd88bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:04.662502 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ead107e8-295a-427e-9d49-af1347bd88bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:04.662933 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ead107e8-295a-427e-9d49-af1347bd88bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:04.663770 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ead107e8-295a-427e-9d49-af1347bd88bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:04.664235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ead107e8-295a-427e-9d49-af1347bd88bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:04.664679 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ead107e8-295a-427e-9d49-af1347bd88bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:04.805656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ead107e8-295a-427e-9d49-af1347bd88bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:04.814945 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ead107e8-295a-427e-9d49-af1347bd88bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:04.816436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ead107e8-295a-427e-9d49-af1347bd88bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:04.817600 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ead107e8-295a-427e-9d49-af1347bd88bc tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.169805 Aug 04 21:50:04.818195 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 436/863] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:50:04 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:50:05.064920 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a211deb6-d1b3-407c-8796-70451601cee9 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:05.065739 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a211deb6-d1b3-407c-8796-70451601cee9 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:05.072537 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a211deb6-d1b3-407c-8796-70451601cee9 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:05.073095 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a211deb6-d1b3-407c-8796-70451601cee9 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:05.073605 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a211deb6-d1b3-407c-8796-70451601cee9 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:05.074408 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a211deb6-d1b3-407c-8796-70451601cee9 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:05.074935 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a211deb6-d1b3-407c-8796-70451601cee9 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:05.075429 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a211deb6-d1b3-407c-8796-70451601cee9 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:05.215158 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a211deb6-d1b3-407c-8796-70451601cee9 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:05.224128 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a211deb6-d1b3-407c-8796-70451601cee9 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1359 microversion: 2.1 time: 0.163162 Aug 04 21:50:05.225049 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 428/864] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:05 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:05.840983 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-52ce73d3-d858-4cbb-985b-c237d9282ad5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:05.841586 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-52ce73d3-d858-4cbb-985b-c237d9282ad5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:05.849424 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-52ce73d3-d858-4cbb-985b-c237d9282ad5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:05.850096 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-52ce73d3-d858-4cbb-985b-c237d9282ad5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:05.850700 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-52ce73d3-d858-4cbb-985b-c237d9282ad5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:05.851832 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-52ce73d3-d858-4cbb-985b-c237d9282ad5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:05.852798 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-52ce73d3-d858-4cbb-985b-c237d9282ad5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:05.853523 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-52ce73d3-d858-4cbb-985b-c237d9282ad5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:05.992201 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-52ce73d3-d858-4cbb-985b-c237d9282ad5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:06.001556 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-52ce73d3-d858-4cbb-985b-c237d9282ad5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:06.003103 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-52ce73d3-d858-4cbb-985b-c237d9282ad5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:06.004312 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-52ce73d3-d858-4cbb-985b-c237d9282ad5 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.167377 Aug 04 21:50:06.005093 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 437/865] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:50:05 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:50:06.248626 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-5b6bf3ec-fa2d-4af5-8f98-ff57271e8dee tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:06.249232 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-5b6bf3ec-fa2d-4af5-8f98-ff57271e8dee tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:06.256724 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5b6bf3ec-fa2d-4af5-8f98-ff57271e8dee tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:06.257520 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5b6bf3ec-fa2d-4af5-8f98-ff57271e8dee tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:06.257968 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5b6bf3ec-fa2d-4af5-8f98-ff57271e8dee tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:06.258693 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5b6bf3ec-fa2d-4af5-8f98-ff57271e8dee tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:06.259145 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5b6bf3ec-fa2d-4af5-8f98-ff57271e8dee tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:06.259566 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5b6bf3ec-fa2d-4af5-8f98-ff57271e8dee tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:06.397184 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5b6bf3ec-fa2d-4af5-8f98-ff57271e8dee tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:06.405566 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-5b6bf3ec-fa2d-4af5-8f98-ff57271e8dee tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1359 microversion: 2.1 time: 0.163871 Aug 04 21:50:06.406585 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 429/866] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:06 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:07.028953 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-79fba5cb-5d2a-4e66-912f-4e6344841930 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:07.029750 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-79fba5cb-5d2a-4e66-912f-4e6344841930 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:07.037397 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-79fba5cb-5d2a-4e66-912f-4e6344841930 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:07.037895 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-79fba5cb-5d2a-4e66-912f-4e6344841930 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:07.042331 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-79fba5cb-5d2a-4e66-912f-4e6344841930 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:07.043453 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-79fba5cb-5d2a-4e66-912f-4e6344841930 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:07.044279 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-79fba5cb-5d2a-4e66-912f-4e6344841930 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:07.044617 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-79fba5cb-5d2a-4e66-912f-4e6344841930 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:07.049256 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=100 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:50:07.210584 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-79fba5cb-5d2a-4e66-912f-4e6344841930 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:07.228925 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-79fba5cb-5d2a-4e66-912f-4e6344841930 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:07.230588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-79fba5cb-5d2a-4e66-912f-4e6344841930 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:07.232131 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-79fba5cb-5d2a-4e66-912f-4e6344841930 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.206982 Aug 04 21:50:07.233224 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 438/867] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:50:07 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:50:07.428531 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-6cde8b3c-4e41-469a-be82-c973147f3908 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:07.430102 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-6cde8b3c-4e41-469a-be82-c973147f3908 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:07.439176 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6cde8b3c-4e41-469a-be82-c973147f3908 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:07.440013 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6cde8b3c-4e41-469a-be82-c973147f3908 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:07.440624 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6cde8b3c-4e41-469a-be82-c973147f3908 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:07.441502 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6cde8b3c-4e41-469a-be82-c973147f3908 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:07.442429 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6cde8b3c-4e41-469a-be82-c973147f3908 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:07.443850 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6cde8b3c-4e41-469a-be82-c973147f3908 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:07.611054 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6cde8b3c-4e41-469a-be82-c973147f3908 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:07.619481 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-6cde8b3c-4e41-469a-be82-c973147f3908 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1359 microversion: 2.1 time: 0.195241 Aug 04 21:50:07.620344 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 430/868] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:07 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:08.260932 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-fb8feb69-2e65-4c67-ae8d-79565aedeb04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:08.261662 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-fb8feb69-2e65-4c67-ae8d-79565aedeb04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:08.269398 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fb8feb69-2e65-4c67-ae8d-79565aedeb04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:08.269874 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fb8feb69-2e65-4c67-ae8d-79565aedeb04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:08.270338 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fb8feb69-2e65-4c67-ae8d-79565aedeb04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:08.271024 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fb8feb69-2e65-4c67-ae8d-79565aedeb04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:08.271467 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fb8feb69-2e65-4c67-ae8d-79565aedeb04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:08.271883 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fb8feb69-2e65-4c67-ae8d-79565aedeb04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:08.400495 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-fb8feb69-2e65-4c67-ae8d-79565aedeb04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:08.409383 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-fb8feb69-2e65-4c67-ae8d-79565aedeb04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:08.410903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-fb8feb69-2e65-4c67-ae8d-79565aedeb04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:08.412047 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-fb8feb69-2e65-4c67-ae8d-79565aedeb04 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.155405 Aug 04 21:50:08.412600 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 439/869] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:50:08 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:50:08.641303 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-cb351b2c-4fa4-4a88-9f8f-a9f70e3d19fb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:08.641973 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-cb351b2c-4fa4-4a88-9f8f-a9f70e3d19fb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:08.648411 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cb351b2c-4fa4-4a88-9f8f-a9f70e3d19fb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:08.648896 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cb351b2c-4fa4-4a88-9f8f-a9f70e3d19fb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:08.649336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cb351b2c-4fa4-4a88-9f8f-a9f70e3d19fb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:08.650050 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cb351b2c-4fa4-4a88-9f8f-a9f70e3d19fb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:08.650506 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cb351b2c-4fa4-4a88-9f8f-a9f70e3d19fb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:08.650929 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cb351b2c-4fa4-4a88-9f8f-a9f70e3d19fb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:08.782099 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-cb351b2c-4fa4-4a88-9f8f-a9f70e3d19fb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:08.789583 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-cb351b2c-4fa4-4a88-9f8f-a9f70e3d19fb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1359 microversion: 2.1 time: 0.152668 Aug 04 21:50:08.790076 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 431/870] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:08 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:09.436117 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-1c27c638-6bd0-4a64-a88a-0f670ff7b189 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:09.436727 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-1c27c638-6bd0-4a64-a88a-0f670ff7b189 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:09.444017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c27c638-6bd0-4a64-a88a-0f670ff7b189 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:09.444493 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c27c638-6bd0-4a64-a88a-0f670ff7b189 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:09.444923 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c27c638-6bd0-4a64-a88a-0f670ff7b189 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:09.445609 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c27c638-6bd0-4a64-a88a-0f670ff7b189 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:09.446089 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c27c638-6bd0-4a64-a88a-0f670ff7b189 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:09.446508 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c27c638-6bd0-4a64-a88a-0f670ff7b189 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:09.584925 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1c27c638-6bd0-4a64-a88a-0f670ff7b189 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:09.593181 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1c27c638-6bd0-4a64-a88a-0f670ff7b189 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:09.601551 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1c27c638-6bd0-4a64-a88a-0f670ff7b189 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:09.601551 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-1c27c638-6bd0-4a64-a88a-0f670ff7b189 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.164591 Aug 04 21:50:09.601551 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 440/871] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:50:09 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:50:09.810247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-668357cb-80be-4ab9-98c7-6f3347bfa67d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:09.810854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-668357cb-80be-4ab9-98c7-6f3347bfa67d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:09.817735 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-668357cb-80be-4ab9-98c7-6f3347bfa67d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:09.818240 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-668357cb-80be-4ab9-98c7-6f3347bfa67d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:09.818668 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-668357cb-80be-4ab9-98c7-6f3347bfa67d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:09.819345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-668357cb-80be-4ab9-98c7-6f3347bfa67d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:09.819784 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-668357cb-80be-4ab9-98c7-6f3347bfa67d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:09.820201 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-668357cb-80be-4ab9-98c7-6f3347bfa67d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:09.948920 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-668357cb-80be-4ab9-98c7-6f3347bfa67d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:09.957506 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-668357cb-80be-4ab9-98c7-6f3347bfa67d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1359 microversion: 2.1 time: 0.151106 Aug 04 21:50:09.958102 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 432/872] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:09 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:10.619312 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ec66c344-4c9d-44a1-ba66-91eda92f4fc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:10.619933 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ec66c344-4c9d-44a1-ba66-91eda92f4fc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:10.626891 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ec66c344-4c9d-44a1-ba66-91eda92f4fc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:10.627398 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ec66c344-4c9d-44a1-ba66-91eda92f4fc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:10.627823 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ec66c344-4c9d-44a1-ba66-91eda92f4fc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:10.628579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ec66c344-4c9d-44a1-ba66-91eda92f4fc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:10.629230 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ec66c344-4c9d-44a1-ba66-91eda92f4fc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:10.629645 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ec66c344-4c9d-44a1-ba66-91eda92f4fc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:10.787249 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-b982679a-cdcd-44d8-a4e5-995dba27ea04 req-510e29e5-d2ee-4c46-81f9-e92b278fe0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b239b668-0156-411a-8a3b-45ce0c119e28", "tag": "85083dfa-01f6-49d9-a92d-4bfee46f59b9"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:50:10.789956 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ec66c344-4c9d-44a1-ba66-91eda92f4fc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:10.798938 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-b982679a-cdcd-44d8-a4e5-995dba27ea04 req-510e29e5-d2ee-4c46-81f9-e92b278fe0f6 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:10.799608 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-b982679a-cdcd-44d8-a4e5-995dba27ea04 req-510e29e5-d2ee-4c46-81f9-e92b278fe0f6 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:10.800042 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-b982679a-cdcd-44d8-a4e5-995dba27ea04 req-510e29e5-d2ee-4c46-81f9-e92b278fe0f6 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:10.802173 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ec66c344-4c9d-44a1-ba66-91eda92f4fc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:10.804249 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ec66c344-4c9d-44a1-ba66-91eda92f4fc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:10.806045 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ec66c344-4c9d-44a1-ba66-91eda92f4fc8 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.190246 Aug 04 21:50:10.816249 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 441/873] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:50:10 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:50:10.824750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-b982679a-cdcd-44d8-a4e5-995dba27ea04 req-510e29e5-d2ee-4c46-81f9-e92b278fe0f6 service nova] Creating event network-changed:85083dfa-01f6-49d9-a92d-4bfee46f59b9 for instance b239b668-0156-411a-8a3b-45ce0c119e28 on hv-cinder-85220 Aug 04 21:50:10.830367 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-b982679a-cdcd-44d8-a4e5-995dba27ea04 req-510e29e5-d2ee-4c46-81f9-e92b278fe0f6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048908 Aug 04 21:50:10.831238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 433/874] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:50:10.841388 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-144d680c-27f0-4acc-8208-0b3a2aa3de90 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:10.844359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-144d680c-27f0-4acc-8208-0b3a2aa3de90 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:10.851281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-144d680c-27f0-4acc-8208-0b3a2aa3de90 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:10.851281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-144d680c-27f0-4acc-8208-0b3a2aa3de90 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:10.851281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-144d680c-27f0-4acc-8208-0b3a2aa3de90 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:10.851999 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-144d680c-27f0-4acc-8208-0b3a2aa3de90 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:10.852446 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-144d680c-27f0-4acc-8208-0b3a2aa3de90 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:10.852862 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-144d680c-27f0-4acc-8208-0b3a2aa3de90 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:10.881997 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-144d680c-27f0-4acc-8208-0b3a2aa3de90 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044721 Aug 04 21:50:10.882561 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 442/875] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:50:10 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:50:10.978572 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a64a0795-9276-4a73-90d7-7cfaf9e2121d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:10.979267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a64a0795-9276-4a73-90d7-7cfaf9e2121d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:10.986066 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a64a0795-9276-4a73-90d7-7cfaf9e2121d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:10.986539 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a64a0795-9276-4a73-90d7-7cfaf9e2121d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:10.987071 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a64a0795-9276-4a73-90d7-7cfaf9e2121d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:10.987788 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a64a0795-9276-4a73-90d7-7cfaf9e2121d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:10.988231 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a64a0795-9276-4a73-90d7-7cfaf9e2121d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:10.988647 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a64a0795-9276-4a73-90d7-7cfaf9e2121d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:11.121195 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a64a0795-9276-4a73-90d7-7cfaf9e2121d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:11.130085 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a64a0795-9276-4a73-90d7-7cfaf9e2121d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1359 microversion: 2.1 time: 0.155723 Aug 04 21:50:11.131478 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 434/876] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:10 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:11.828998 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6da71797-cf10-4dc7-9456-1d198c977ce0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:11.829828 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-6da71797-cf10-4dc7-9456-1d198c977ce0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:11.836553 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6da71797-cf10-4dc7-9456-1d198c977ce0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:11.837032 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6da71797-cf10-4dc7-9456-1d198c977ce0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:11.837655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6da71797-cf10-4dc7-9456-1d198c977ce0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:11.838407 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6da71797-cf10-4dc7-9456-1d198c977ce0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:11.838857 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6da71797-cf10-4dc7-9456-1d198c977ce0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:11.839279 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6da71797-cf10-4dc7-9456-1d198c977ce0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:11.895554 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c9ebfa89-41c2-469b-af68-740b77e39600 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:11.897903 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c9ebfa89-41c2-469b-af68-740b77e39600 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:11.904224 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9ebfa89-41c2-469b-af68-740b77e39600 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:11.904704 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9ebfa89-41c2-469b-af68-740b77e39600 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:11.905132 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9ebfa89-41c2-469b-af68-740b77e39600 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:11.905812 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9ebfa89-41c2-469b-af68-740b77e39600 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:11.907288 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9ebfa89-41c2-469b-af68-740b77e39600 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:11.907813 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9ebfa89-41c2-469b-af68-740b77e39600 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:11.938153 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c9ebfa89-41c2-469b-af68-740b77e39600 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047109 Aug 04 21:50:11.939177 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 435/877] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:50:11 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 21:50:12.020928 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6da71797-cf10-4dc7-9456-1d198c977ce0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:12.028793 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6da71797-cf10-4dc7-9456-1d198c977ce0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:12.030331 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6da71797-cf10-4dc7-9456-1d198c977ce0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:12.032076 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-6da71797-cf10-4dc7-9456-1d198c977ce0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.207215 Aug 04 21:50:12.032631 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 443/878] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:50:11 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:50:12.068701 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-6e621f8a-008c-4356-a690-601b2d3cf6a9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:12.070888 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-6e621f8a-008c-4356-a690-601b2d3cf6a9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:12.076801 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e621f8a-008c-4356-a690-601b2d3cf6a9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:12.077282 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e621f8a-008c-4356-a690-601b2d3cf6a9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:12.077715 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e621f8a-008c-4356-a690-601b2d3cf6a9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:12.079036 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e621f8a-008c-4356-a690-601b2d3cf6a9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:12.079483 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e621f8a-008c-4356-a690-601b2d3cf6a9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:12.079906 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e621f8a-008c-4356-a690-601b2d3cf6a9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:12.107248 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-6e621f8a-008c-4356-a690-601b2d3cf6a9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042458 Aug 04 21:50:12.107794 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 436/879] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:50:12 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:50:12.150832 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-5ad38a56-6fd0-4c9e-96c2-fd067322f04e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:12.151547 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-5ad38a56-6fd0-4c9e-96c2-fd067322f04e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:12.157382 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5ad38a56-6fd0-4c9e-96c2-fd067322f04e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:12.157852 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5ad38a56-6fd0-4c9e-96c2-fd067322f04e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:12.158343 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5ad38a56-6fd0-4c9e-96c2-fd067322f04e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:12.159045 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5ad38a56-6fd0-4c9e-96c2-fd067322f04e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:12.159489 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5ad38a56-6fd0-4c9e-96c2-fd067322f04e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:12.159952 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5ad38a56-6fd0-4c9e-96c2-fd067322f04e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:12.171035 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-25b720df-1928-4118-8d58-1f0c284d1035 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:12.171527 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-25b720df-1928-4118-8d58-1f0c284d1035 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:12.177791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-25b720df-1928-4118-8d58-1f0c284d1035 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:12.178303 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-25b720df-1928-4118-8d58-1f0c284d1035 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:12.178740 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-25b720df-1928-4118-8d58-1f0c284d1035 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:12.179428 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-25b720df-1928-4118-8d58-1f0c284d1035 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:12.179879 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-25b720df-1928-4118-8d58-1f0c284d1035 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:12.180302 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-25b720df-1928-4118-8d58-1f0c284d1035 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:12.206062 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-25b720df-1928-4118-8d58-1f0c284d1035 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Going to try to terminate instance {{(pid=136341) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:50:12.292100 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-5ad38a56-6fd0-4c9e-96c2-fd067322f04e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:12.300501 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-5ad38a56-6fd0-4c9e-96c2-fd067322f04e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1359 microversion: 2.1 time: 0.153531 Aug 04 21:50:12.301063 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 444/880] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:12 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:12.507986 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-25b720df-1928-4118-8d58-1f0c284d1035 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 204 len: 0 microversion: 2.1 time: 0.339928 Aug 04 21:50:12.508869 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 437/881] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:50:12 2022] DELETE /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 21:50:12.518174 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-99aa3bd6-3a49-448e-95ab-b21464368b3a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:12.519090 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-99aa3bd6-3a49-448e-95ab-b21464368b3a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:12.528684 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-99aa3bd6-3a49-448e-95ab-b21464368b3a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:12.529187 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-99aa3bd6-3a49-448e-95ab-b21464368b3a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:12.529620 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-99aa3bd6-3a49-448e-95ab-b21464368b3a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:12.530368 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-99aa3bd6-3a49-448e-95ab-b21464368b3a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:12.530981 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-99aa3bd6-3a49-448e-95ab-b21464368b3a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:12.532439 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-99aa3bd6-3a49-448e-95ab-b21464368b3a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:12.684555 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-99aa3bd6-3a49-448e-95ab-b21464368b3a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:12.693003 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-99aa3bd6-3a49-448e-95ab-b21464368b3a tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 200 len: 1672 microversion: 2.1 time: 0.179938 Aug 04 21:50:12.693567 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 445/882] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:12 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 1672 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:13.055874 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-1a18c341-b098-4975-8e4d-daa19083b914 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:13.056569 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-1a18c341-b098-4975-8e4d-daa19083b914 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:13.063124 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1a18c341-b098-4975-8e4d-daa19083b914 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:13.063544 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1a18c341-b098-4975-8e4d-daa19083b914 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:13.063978 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1a18c341-b098-4975-8e4d-daa19083b914 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:13.064668 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1a18c341-b098-4975-8e4d-daa19083b914 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:13.065109 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1a18c341-b098-4975-8e4d-daa19083b914 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:13.065522 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1a18c341-b098-4975-8e4d-daa19083b914 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:13.200038 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-1a18c341-b098-4975-8e4d-daa19083b914 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:13.208552 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-1a18c341-b098-4975-8e4d-daa19083b914 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:13.210072 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-1a18c341-b098-4975-8e4d-daa19083b914 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:13.211226 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-1a18c341-b098-4975-8e4d-daa19083b914 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.159771 Aug 04 21:50:13.211822 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 438/883] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:50:13 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:50:13.321311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-bef28e40-9dca-4fa5-a962-4a792e9b2c0d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:13.321854 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-bef28e40-9dca-4fa5-a962-4a792e9b2c0d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:13.328885 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bef28e40-9dca-4fa5-a962-4a792e9b2c0d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:13.329386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bef28e40-9dca-4fa5-a962-4a792e9b2c0d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:13.329928 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bef28e40-9dca-4fa5-a962-4a792e9b2c0d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:13.330679 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bef28e40-9dca-4fa5-a962-4a792e9b2c0d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:13.331138 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bef28e40-9dca-4fa5-a962-4a792e9b2c0d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:13.331561 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bef28e40-9dca-4fa5-a962-4a792e9b2c0d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:13.467560 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-bef28e40-9dca-4fa5-a962-4a792e9b2c0d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:13.475637 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-bef28e40-9dca-4fa5-a962-4a792e9b2c0d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1359 microversion: 2.1 time: 0.158527 Aug 04 21:50:13.483883 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 446/884] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:13 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:50:13.714629 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2a5e1e04-03b1-4053-ba1f-82a95d49259e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:13.715229 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-2a5e1e04-03b1-4053-ba1f-82a95d49259e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:13.722116 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2a5e1e04-03b1-4053-ba1f-82a95d49259e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:13.722601 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2a5e1e04-03b1-4053-ba1f-82a95d49259e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:13.723032 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2a5e1e04-03b1-4053-ba1f-82a95d49259e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:13.723713 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2a5e1e04-03b1-4053-ba1f-82a95d49259e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:13.724161 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2a5e1e04-03b1-4053-ba1f-82a95d49259e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:13.724584 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2a5e1e04-03b1-4053-ba1f-82a95d49259e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:13.854552 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2a5e1e04-03b1-4053-ba1f-82a95d49259e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:13.863045 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2a5e1e04-03b1-4053-ba1f-82a95d49259e tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 200 len: 1672 microversion: 2.1 time: 0.152351 Aug 04 21:50:13.863624 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 439/885] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:13 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:14.236105 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6ae74174-ea7e-4417-9e16-19422d742a69 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:14.236969 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-6ae74174-ea7e-4417-9e16-19422d742a69 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:14.243567 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6ae74174-ea7e-4417-9e16-19422d742a69 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:14.246118 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6ae74174-ea7e-4417-9e16-19422d742a69 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:14.246118 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6ae74174-ea7e-4417-9e16-19422d742a69 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:14.246118 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6ae74174-ea7e-4417-9e16-19422d742a69 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:14.246118 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6ae74174-ea7e-4417-9e16-19422d742a69 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:14.246498 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6ae74174-ea7e-4417-9e16-19422d742a69 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:14.446770 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6ae74174-ea7e-4417-9e16-19422d742a69 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:14.457063 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6ae74174-ea7e-4417-9e16-19422d742a69 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:14.458741 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6ae74174-ea7e-4417-9e16-19422d742a69 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:14.459908 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-6ae74174-ea7e-4417-9e16-19422d742a69 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1730 microversion: 2.20 time: 0.227906 Aug 04 21:50:14.460469 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 447/886] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:50:14 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1730 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:50:14.497883 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f89332cd-1e04-40d6-bbcb-36986949363b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:14.504419 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-f89332cd-1e04-40d6-bbcb-36986949363b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:14.505618 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f89332cd-1e04-40d6-bbcb-36986949363b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:14.506196 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f89332cd-1e04-40d6-bbcb-36986949363b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:14.506631 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f89332cd-1e04-40d6-bbcb-36986949363b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:14.507351 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f89332cd-1e04-40d6-bbcb-36986949363b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:14.507799 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f89332cd-1e04-40d6-bbcb-36986949363b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:14.508218 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f89332cd-1e04-40d6-bbcb-36986949363b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:14.640612 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f89332cd-1e04-40d6-bbcb-36986949363b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:14.648209 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f89332cd-1e04-40d6-bbcb-36986949363b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1359 microversion: 2.1 time: 0.154490 Aug 04 21:50:14.648757 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 440/887] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:14 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:14.885084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-04fc5ca2-a08a-415c-a745-db9000bb4f38 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:14.885602 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-04fc5ca2-a08a-415c-a745-db9000bb4f38 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:14.891521 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-04fc5ca2-a08a-415c-a745-db9000bb4f38 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:14.891998 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-04fc5ca2-a08a-415c-a745-db9000bb4f38 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:14.892426 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-04fc5ca2-a08a-415c-a745-db9000bb4f38 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:14.893103 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-04fc5ca2-a08a-415c-a745-db9000bb4f38 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:14.893550 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-04fc5ca2-a08a-415c-a745-db9000bb4f38 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:14.894502 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-04fc5ca2-a08a-415c-a745-db9000bb4f38 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:15.030413 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-04fc5ca2-a08a-415c-a745-db9000bb4f38 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:15.038041 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-04fc5ca2-a08a-415c-a745-db9000bb4f38 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 200 len: 1672 microversion: 2.1 time: 0.156819 Aug 04 21:50:15.038593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 448/888] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:14 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:15.483476 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-930ebc6e-dccc-458a-bb52-d6f9155f5005 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:15.484079 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-930ebc6e-dccc-458a-bb52-d6f9155f5005 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:15.490212 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-930ebc6e-dccc-458a-bb52-d6f9155f5005 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:15.490768 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-930ebc6e-dccc-458a-bb52-d6f9155f5005 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:15.491201 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-930ebc6e-dccc-458a-bb52-d6f9155f5005 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:15.492054 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-930ebc6e-dccc-458a-bb52-d6f9155f5005 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:15.492546 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-930ebc6e-dccc-458a-bb52-d6f9155f5005 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:15.492980 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-930ebc6e-dccc-458a-bb52-d6f9155f5005 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:15.495808 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:50:15.630199 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-930ebc6e-dccc-458a-bb52-d6f9155f5005 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:15.638125 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-930ebc6e-dccc-458a-bb52-d6f9155f5005 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:15.639608 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-930ebc6e-dccc-458a-bb52-d6f9155f5005 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:15.640744 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-930ebc6e-dccc-458a-bb52-d6f9155f5005 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1717 microversion: 2.20 time: 0.161483 Aug 04 21:50:15.641293 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 441/889] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:50:15 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1717 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:50:15.668519 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e27943f9-5c8b-41a3-b3dc-83a2a274d1de tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:15.669138 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e27943f9-5c8b-41a3-b3dc-83a2a274d1de tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:15.675941 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e27943f9-5c8b-41a3-b3dc-83a2a274d1de tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:15.676433 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e27943f9-5c8b-41a3-b3dc-83a2a274d1de tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:15.676874 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e27943f9-5c8b-41a3-b3dc-83a2a274d1de tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:15.677594 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e27943f9-5c8b-41a3-b3dc-83a2a274d1de tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:15.678078 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e27943f9-5c8b-41a3-b3dc-83a2a274d1de tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:15.678509 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e27943f9-5c8b-41a3-b3dc-83a2a274d1de tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:15.807303 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e27943f9-5c8b-41a3-b3dc-83a2a274d1de tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:15.814852 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e27943f9-5c8b-41a3-b3dc-83a2a274d1de tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1359 microversion: 2.1 time: 0.149979 Aug 04 21:50:15.815245 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 449/890] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:15 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:16.059522 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-4333d0e4-015e-42d6-8ce2-a24264562afd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:16.060047 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-4333d0e4-015e-42d6-8ce2-a24264562afd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:16.066462 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4333d0e4-015e-42d6-8ce2-a24264562afd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:16.066937 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4333d0e4-015e-42d6-8ce2-a24264562afd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:16.067365 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4333d0e4-015e-42d6-8ce2-a24264562afd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:16.068361 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4333d0e4-015e-42d6-8ce2-a24264562afd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:16.068811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4333d0e4-015e-42d6-8ce2-a24264562afd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:16.069226 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4333d0e4-015e-42d6-8ce2-a24264562afd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:16.199100 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4333d0e4-015e-42d6-8ce2-a24264562afd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:16.207221 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-4333d0e4-015e-42d6-8ce2-a24264562afd tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 200 len: 1672 microversion: 2.1 time: 0.150970 Aug 04 21:50:16.207787 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 442/891] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:16 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:16.837215 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-19121476-cd5a-44d2-9e9a-4ed726066aba tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:16.837802 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-19121476-cd5a-44d2-9e9a-4ed726066aba tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:16.844508 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-19121476-cd5a-44d2-9e9a-4ed726066aba tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:16.844991 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-19121476-cd5a-44d2-9e9a-4ed726066aba tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:16.845429 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-19121476-cd5a-44d2-9e9a-4ed726066aba tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:16.846152 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-19121476-cd5a-44d2-9e9a-4ed726066aba tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:16.846644 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-19121476-cd5a-44d2-9e9a-4ed726066aba tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:16.847195 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-19121476-cd5a-44d2-9e9a-4ed726066aba tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:17.051863 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-19121476-cd5a-44d2-9e9a-4ed726066aba tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:17.059233 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-19121476-cd5a-44d2-9e9a-4ed726066aba tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1359 microversion: 2.1 time: 0.225977 Aug 04 21:50:17.059798 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 450/892] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:16 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:50:17.229217 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-1b12503a-db72-44e8-ae84-86591cd3e7f6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:17.229841 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-1b12503a-db72-44e8-ae84-86591cd3e7f6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:17.236099 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1b12503a-db72-44e8-ae84-86591cd3e7f6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:17.236577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1b12503a-db72-44e8-ae84-86591cd3e7f6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:17.237009 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1b12503a-db72-44e8-ae84-86591cd3e7f6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:17.238371 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1b12503a-db72-44e8-ae84-86591cd3e7f6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:17.238825 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1b12503a-db72-44e8-ae84-86591cd3e7f6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:17.239239 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1b12503a-db72-44e8-ae84-86591cd3e7f6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:17.434234 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-1b12503a-db72-44e8-ae84-86591cd3e7f6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:17.442538 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-1b12503a-db72-44e8-ae84-86591cd3e7f6 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 200 len: 1672 microversion: 2.1 time: 0.217108 Aug 04 21:50:17.443116 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 443/893] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:17 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 1672 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:50:18.080172 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-5d709bdb-e0cc-471e-942d-ef15c4305e87 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:18.080770 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-5d709bdb-e0cc-471e-942d-ef15c4305e87 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:18.088468 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5d709bdb-e0cc-471e-942d-ef15c4305e87 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:18.088956 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5d709bdb-e0cc-471e-942d-ef15c4305e87 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:18.089383 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5d709bdb-e0cc-471e-942d-ef15c4305e87 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:18.090096 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5d709bdb-e0cc-471e-942d-ef15c4305e87 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:18.090715 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5d709bdb-e0cc-471e-942d-ef15c4305e87 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:18.091575 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5d709bdb-e0cc-471e-942d-ef15c4305e87 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:18.162411 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-9223c383-825e-483c-ad1f-7ffff0d9cf80 req-25fa87f0-79c3-43fc-b90b-8a370a7f4486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce7b7159-6eae-4d5b-916c-43e4a21a6f60", "name": "network-vif-deleted", "tag": "09cebf2f-8044-46a6-b504-0e5c712a09d9"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:50:18.163100 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-9223c383-825e-483c-ad1f-7ffff0d9cf80 req-25fa87f0-79c3-43fc-b90b-8a370a7f4486 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:18.163580 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-9223c383-825e-483c-ad1f-7ffff0d9cf80 req-25fa87f0-79c3-43fc-b90b-8a370a7f4486 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:18.164013 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-9223c383-825e-483c-ad1f-7ffff0d9cf80 req-25fa87f0-79c3-43fc-b90b-8a370a7f4486 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:18.176227 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-9223c383-825e-483c-ad1f-7ffff0d9cf80 req-25fa87f0-79c3-43fc-b90b-8a370a7f4486 service nova] Creating event network-vif-deleted:09cebf2f-8044-46a6-b504-0e5c712a09d9 for instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 on hv-cinder-85220 Aug 04 21:50:18.184605 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-9223c383-825e-483c-ad1f-7ffff0d9cf80 req-25fa87f0-79c3-43fc-b90b-8a370a7f4486 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032741 Aug 04 21:50:18.184605 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 444/894] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:50:18.296578 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-5d709bdb-e0cc-471e-942d-ef15c4305e87 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:18.304657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-5d709bdb-e0cc-471e-942d-ef15c4305e87 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1359 microversion: 2.1 time: 0.228401 Aug 04 21:50:18.305219 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 451/895] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:18 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:18.465400 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-dd33dd2e-909e-4be2-bd0b-794b37e2ca10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:18.468341 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-dd33dd2e-909e-4be2-bd0b-794b37e2ca10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:18.472626 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dd33dd2e-909e-4be2-bd0b-794b37e2ca10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:18.473108 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dd33dd2e-909e-4be2-bd0b-794b37e2ca10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:18.473540 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dd33dd2e-909e-4be2-bd0b-794b37e2ca10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:18.474270 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dd33dd2e-909e-4be2-bd0b-794b37e2ca10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:18.474717 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dd33dd2e-909e-4be2-bd0b-794b37e2ca10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:18.475176 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dd33dd2e-909e-4be2-bd0b-794b37e2ca10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:18.520706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dd33dd2e-909e-4be2-bd0b-794b37e2ca10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:18.521202 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dd33dd2e-909e-4be2-bd0b-794b37e2ca10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:18.521636 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dd33dd2e-909e-4be2-bd0b-794b37e2ca10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:18.522141 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.objects.instance [None req-dd33dd2e-909e-4be2-bd0b-794b37e2ca10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lazy-loading 'fault' on Instance uuid ce7b7159-6eae-4d5b-916c-43e4a21a6f60 {{(pid=136341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:50:18.567833 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-dd33dd2e-909e-4be2-bd0b-794b37e2ca10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23fcabad2354e7ab51a22b412bf11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09370df0a2354bd2a412c6770d3ff165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:18.574614 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-dd33dd2e-909e-4be2-bd0b-794b37e2ca10 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 200 len: 1327 microversion: 2.1 time: 0.113933 Aug 04 21:50:18.575193 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 445/896] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:18 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:19.326282 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e7bcbe97-7b08-4517-b10b-f66738839729 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:19.327113 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e7bcbe97-7b08-4517-b10b-f66738839729 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:19.334050 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e7bcbe97-7b08-4517-b10b-f66738839729 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:19.334546 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e7bcbe97-7b08-4517-b10b-f66738839729 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:19.334985 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e7bcbe97-7b08-4517-b10b-f66738839729 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:19.335680 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e7bcbe97-7b08-4517-b10b-f66738839729 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:19.336135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e7bcbe97-7b08-4517-b10b-f66738839729 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:19.336561 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e7bcbe97-7b08-4517-b10b-f66738839729 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:19.471161 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e7bcbe97-7b08-4517-b10b-f66738839729 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:19.479899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e7bcbe97-7b08-4517-b10b-f66738839729 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1359 microversion: 2.1 time: 0.157575 Aug 04 21:50:19.481070 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 452/897] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:19 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:19.599047 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-bb04fe7e-4b5d-4feb-a5e8-b7c92c63a945 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:19.599656 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-bb04fe7e-4b5d-4feb-a5e8-b7c92c63a945 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:19.606060 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bb04fe7e-4b5d-4feb-a5e8-b7c92c63a945 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:19.606551 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bb04fe7e-4b5d-4feb-a5e8-b7c92c63a945 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:19.607013 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bb04fe7e-4b5d-4feb-a5e8-b7c92c63a945 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:19.607740 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bb04fe7e-4b5d-4feb-a5e8-b7c92c63a945 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:19.608187 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bb04fe7e-4b5d-4feb-a5e8-b7c92c63a945 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:19.608607 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bb04fe7e-4b5d-4feb-a5e8-b7c92c63a945 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:19.623000 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-bb04fe7e-4b5d-4feb-a5e8-b7c92c63a945 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] HTTP exception thrown: Instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 could not be found. Aug 04 21:50:19.624649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-bb04fe7e-4b5d-4feb-a5e8-b7c92c63a945 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Request method failure captured: Aug 04 21:50:19.624649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 HTTP/1.1 Aug 04 21:50:19.624649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:50:19.624649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:50:19.624649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:50:19.624649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 21:50:19.624649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:50:19.624649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:50:19.624649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:50:19.624649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:50:19.624649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7DzKJTsJAHPDhJ8CMuf9KkeK11MhLOSHwTHX7vzm8TbfgcJVNWjadZ85KdKsVcHVvFkKn0cT0xu9ul8CaY82QzjSHg1WGhr5_hU-MhpmSf7GBIM8UkxIT8_GJsae52KTrCsFMxroACrk7UlCOx-g-7Paunx7vrjm8yxNgR1ylXRGvVw Aug 04 21:50:19.624649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:50:19.624649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:50:19.624649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:50:19.624649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:50:19.624649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:50:19.624649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:50:19.624649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: 09370df0a2354bd2a412c6770d3ff165 Aug 04 21:50:19.624649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-AttachVolumeTestJSON-1799315316 Aug 04 21:50:19.624649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:50:19.624649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:50:19.626353 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_09370df0a2354bd2a412c6770d3ff165", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/09370df0a2354bd2a412c6770d3ff165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/09370df0a2354bd2a412c6770d3ff165"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/09370df0a2354bd2a412c6770d3ff165"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:50:19.626353 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-AttachVolumeTestJSON-1799315316 Aug 04 21:50:19.626353 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: 09370df0a2354bd2a412c6770d3ff165 Aug 04 21:50:19.626353 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1799315316 Aug 04 21:50:19.626353 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-AttachVolumeTestJSON-1799315316-project Aug 04 21:50:19.626353 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:50:19.626353 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:50:19.626353 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: a23fcabad2354e7ab51a22b412bf11e6 Aug 04 21:50:19.626353 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-AttachVolumeTestJSON-1799315316-project Aug 04 21:50:19.626353 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 21:50:19.626353 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 could not be found. Aug 04 21:50:19.626353 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': 'ce7b7159-6eae-4d5b-916c-43e4a21a6f60'} Aug 04 21:50:19.627164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:50:19.627164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:50:19.627164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:50:19.627164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:50:19.627164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:50:19.627164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:50:19.627164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:50:19.627164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:50:19.627164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:50:19.627164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:50:19.627164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 could not be found. Aug 04 21:50:19.627164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:50:19.627164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:50:19.627164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:50:19.627164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:50:19.627164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:50:19.627164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:50:19.627164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:50:19.627164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:50:19.627164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:50:19.628494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:50:19.628494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:50:19.628494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:50:19.628494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:50:19.628494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:50:19.628494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:50:19.628494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:50:19.628494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 could not be found. Aug 04 21:50:19.628494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:50:19.628494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:50:19.628494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:50:19.628494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:50:19.628494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:50:19.628494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:50:19.628494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:50:19.628494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:50:19.628494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 could not be found. Aug 04 21:50:19.628494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:50:19.629837 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-bb04fe7e-4b5d-4feb-a5e8-b7c92c63a945 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Returning 404 to user: Instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:50:19.629837 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-bb04fe7e-4b5d-4feb-a5e8-b7c92c63a945 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 404 len: 111 microversion: 2.1 time: 0.031638 Aug 04 21:50:19.629837 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 446/898] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:19 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:50:19.636111 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-93efdb5d-5a62-4a58-abad-234842431dbe tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '.version_select at 0x7f3c14f8a820>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:19.736002 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-93efdb5d-5a62-4a58-abad-234842431dbe tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1463358136" status: 202 len: 0 microversion: 2.1 time: 0.103814 Aug 04 21:50:19.736575 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 453/899] 10.222.0.73 () {58 vars in 1221 bytes} [Thu Aug 4 21:50:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1463358136 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:50:20.502427 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-8f886e63-8499-4251-a718-6089253be74a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:20.503055 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-8f886e63-8499-4251-a718-6089253be74a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:20.511406 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8f886e63-8499-4251-a718-6089253be74a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:20.512105 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8f886e63-8499-4251-a718-6089253be74a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:20.512714 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8f886e63-8499-4251-a718-6089253be74a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:20.513432 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8f886e63-8499-4251-a718-6089253be74a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:20.513878 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8f886e63-8499-4251-a718-6089253be74a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:20.514334 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8f886e63-8499-4251-a718-6089253be74a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:20.663179 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8f886e63-8499-4251-a718-6089253be74a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:20.675080 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-8f886e63-8499-4251-a718-6089253be74a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1359 microversion: 2.1 time: 0.172348 Aug 04 21:50:20.675080 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 447/900] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:20 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:20.756540 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-078f43ba-6cd9-4afb-b6a6-6a5bfaf6d856 req-d8f7f581-e99f-434b-ac23-1e9aaddecdba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b239b668-0156-411a-8a3b-45ce0c119e28", "name": "network-vif-plugged", "status": "completed", "tag": "85083dfa-01f6-49d9-a92d-4bfee46f59b9"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:50:20.766859 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-078f43ba-6cd9-4afb-b6a6-6a5bfaf6d856 req-d8f7f581-e99f-434b-ac23-1e9aaddecdba service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:20.767331 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-078f43ba-6cd9-4afb-b6a6-6a5bfaf6d856 req-d8f7f581-e99f-434b-ac23-1e9aaddecdba service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:20.767754 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-078f43ba-6cd9-4afb-b6a6-6a5bfaf6d856 req-d8f7f581-e99f-434b-ac23-1e9aaddecdba service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:20.778673 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-078f43ba-6cd9-4afb-b6a6-6a5bfaf6d856 req-d8f7f581-e99f-434b-ac23-1e9aaddecdba service nova] Creating event network-vif-plugged:85083dfa-01f6-49d9-a92d-4bfee46f59b9 for instance b239b668-0156-411a-8a3b-45ce0c119e28 on hv-cinder-85220 Aug 04 21:50:20.783684 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-078f43ba-6cd9-4afb-b6a6-6a5bfaf6d856 req-d8f7f581-e99f-434b-ac23-1e9aaddecdba service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031979 Aug 04 21:50:20.784757 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 454/901] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:50:21.691725 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d7fa092f-fdb5-4c8b-824e-caf2595e573e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:21.692330 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-d7fa092f-fdb5-4c8b-824e-caf2595e573e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:21.698443 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d7fa092f-fdb5-4c8b-824e-caf2595e573e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:21.698919 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d7fa092f-fdb5-4c8b-824e-caf2595e573e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:21.699350 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d7fa092f-fdb5-4c8b-824e-caf2595e573e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:21.700029 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d7fa092f-fdb5-4c8b-824e-caf2595e573e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:21.700474 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d7fa092f-fdb5-4c8b-824e-caf2595e573e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:21.700890 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d7fa092f-fdb5-4c8b-824e-caf2595e573e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:21.827425 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d7fa092f-fdb5-4c8b-824e-caf2595e573e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:21.835080 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d7fa092f-fdb5-4c8b-824e-caf2595e573e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1359 microversion: 2.1 time: 0.147216 Aug 04 21:50:21.835639 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 448/902] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:21 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:22.856810 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8da3d2b0-c963-44b1-bc39-4fefb3ce318a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:22.857504 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8da3d2b0-c963-44b1-bc39-4fefb3ce318a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:22.863673 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8da3d2b0-c963-44b1-bc39-4fefb3ce318a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:22.864192 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8da3d2b0-c963-44b1-bc39-4fefb3ce318a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:22.864730 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8da3d2b0-c963-44b1-bc39-4fefb3ce318a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:22.865517 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8da3d2b0-c963-44b1-bc39-4fefb3ce318a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:22.865972 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8da3d2b0-c963-44b1-bc39-4fefb3ce318a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:22.866425 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8da3d2b0-c963-44b1-bc39-4fefb3ce318a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:22.997285 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8da3d2b0-c963-44b1-bc39-4fefb3ce318a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:23.005028 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8da3d2b0-c963-44b1-bc39-4fefb3ce318a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1550 microversion: 2.1 time: 0.152997 Aug 04 21:50:23.005588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 455/903] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:22 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1550 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:23.025242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c634d4d3-a747-41b6-946e-718855aa24f0 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:23.025901 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c634d4d3-a747-41b6-946e-718855aa24f0 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:23.032447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c634d4d3-a747-41b6-946e-718855aa24f0 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:23.032929 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c634d4d3-a747-41b6-946e-718855aa24f0 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:23.033358 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c634d4d3-a747-41b6-946e-718855aa24f0 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:23.034077 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c634d4d3-a747-41b6-946e-718855aa24f0 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:23.034527 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c634d4d3-a747-41b6-946e-718855aa24f0 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:23.035032 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c634d4d3-a747-41b6-946e-718855aa24f0 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:23.165931 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-c634d4d3-a747-41b6-946e-718855aa24f0 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:23.168791 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6b488e43-718e-4f22-a45b-3e7312ff39ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:23.169304 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-6b488e43-718e-4f22-a45b-3e7312ff39ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:23.173981 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c634d4d3-a747-41b6-946e-718855aa24f0 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1550 microversion: 2.1 time: 0.153318 Aug 04 21:50:23.174566 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 449/904] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:23 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1550 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:23.175590 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6b488e43-718e-4f22-a45b-3e7312ff39ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:23.176083 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6b488e43-718e-4f22-a45b-3e7312ff39ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:23.176513 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6b488e43-718e-4f22-a45b-3e7312ff39ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:23.177677 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6b488e43-718e-4f22-a45b-3e7312ff39ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:23.178343 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6b488e43-718e-4f22-a45b-3e7312ff39ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:23.178767 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6b488e43-718e-4f22-a45b-3e7312ff39ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:23.193370 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-6b488e43-718e-4f22-a45b-3e7312ff39ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] HTTP exception thrown: Instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 could not be found. Aug 04 21:50:23.194241 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ac59af0e-ce03-4252-bdb5-6f6892fa57f4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:23.195812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6b488e43-718e-4f22-a45b-3e7312ff39ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Request method failure captured: Aug 04 21:50:23.195812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: DELETE /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 HTTP/1.1 Aug 04 21:50:23.195812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:50:23.195812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:50:23.195812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:50:23.195812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:50:23.195812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:50:23.195812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:50:23.195812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:50:23.195812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:50:23.195812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7DzKJTsJAHPDhJ8CMuf9KkeK11MhLOSHwTHX7vzm8TbfgcJVNWjadZ85KdKsVcHVvFkKn0cT0xu9ul8CaY82QzjSHg1WGhr5_hU-MhpmSf7GBIM8UkxIT8_GJsae52KTrCsFMxroACrk7UlCOx-g-7Paunx7vrjm8yxNgR1ylXRGvVw Aug 04 21:50:23.195812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:50:23.195812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:50:23.195812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:50:23.195812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:50:23.195812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:50:23.195812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:50:23.195812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: 09370df0a2354bd2a412c6770d3ff165 Aug 04 21:50:23.195812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-AttachVolumeTestJSON-1799315316 Aug 04 21:50:23.195812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:50:23.195812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:50:23.197386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_09370df0a2354bd2a412c6770d3ff165", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/09370df0a2354bd2a412c6770d3ff165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/09370df0a2354bd2a412c6770d3ff165"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/09370df0a2354bd2a412c6770d3ff165"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:50:23.197386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-AttachVolumeTestJSON-1799315316 Aug 04 21:50:23.197386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: 09370df0a2354bd2a412c6770d3ff165 Aug 04 21:50:23.197386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1799315316 Aug 04 21:50:23.197386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-AttachVolumeTestJSON-1799315316-project Aug 04 21:50:23.197386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:50:23.197386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:50:23.197386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: a23fcabad2354e7ab51a22b412bf11e6 Aug 04 21:50:23.197386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-AttachVolumeTestJSON-1799315316-project Aug 04 21:50:23.197386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:50:23.197386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 could not be found. Aug 04 21:50:23.197386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': 'ce7b7159-6eae-4d5b-916c-43e4a21a6f60'} Aug 04 21:50:23.198311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:50:23.198311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:50:23.198311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:50:23.198311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:50:23.198311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:50:23.198311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:50:23.198311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:50:23.198311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:50:23.198311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:50:23.198311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:50:23.198311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 could not be found. Aug 04 21:50:23.198311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:23.198311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:50:23.198311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:23.198311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:50:23.198311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:50:23.198311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:50:23.198311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:50:23.198311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:50:23.198311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:50:23.202735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:50:23.202735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:50:23.202735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:50:23.202735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:50:23.202735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:50:23.202735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:50:23.202735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:50:23.202735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:50:23.202735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:50:23.202735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 could not be found. Aug 04 21:50:23.202735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:23.202735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:50:23.202735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:23.202735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:50:23.202735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:50:23.202735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:50:23.202735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:50:23.202735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:50:23.202735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 could not be found. Aug 04 21:50:23.202735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:23.204346 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6b488e43-718e-4f22-a45b-3e7312ff39ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Returning 404 to user: Instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:50:23.204346 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-6b488e43-718e-4f22-a45b-3e7312ff39ce tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 404 len: 111 microversion: 2.1 time: 0.032468 Aug 04 21:50:23.204511 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ac59af0e-ce03-4252-bdb5-6f6892fa57f4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:23.204614 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 456/905] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:50:23 2022] DELETE /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:50:23.204712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ac59af0e-ce03-4252-bdb5-6f6892fa57f4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Searching by: {'deleted': False, 'project_id': 'b1685a61dd0844269efb39407dcd1e67'} {{(pid=136341) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 21:50:23.206946 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ac59af0e-ce03-4252-bdb5-6f6892fa57f4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:23.207420 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ac59af0e-ce03-4252-bdb5-6f6892fa57f4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:23.207845 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ac59af0e-ce03-4252-bdb5-6f6892fa57f4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:23.207942 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d2339fe2-a801-42f3-bdc4-3dc705cfb86b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:23.209068 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d2339fe2-a801-42f3-bdc4-3dc705cfb86b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: ce7b7159-6eae-4d5b-916c-43e4a21a6f60] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:23.209205 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ac59af0e-ce03-4252-bdb5-6f6892fa57f4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:23.209643 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ac59af0e-ce03-4252-bdb5-6f6892fa57f4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:23.210082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ac59af0e-ce03-4252-bdb5-6f6892fa57f4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:23.215194 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d2339fe2-a801-42f3-bdc4-3dc705cfb86b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:23.215630 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d2339fe2-a801-42f3-bdc4-3dc705cfb86b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:23.216061 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d2339fe2-a801-42f3-bdc4-3dc705cfb86b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:23.216753 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d2339fe2-a801-42f3-bdc4-3dc705cfb86b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:23.217209 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d2339fe2-a801-42f3-bdc4-3dc705cfb86b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:23.217631 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d2339fe2-a801-42f3-bdc4-3dc705cfb86b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:23.220356 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=100 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:50:23.233126 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-d2339fe2-a801-42f3-bdc4-3dc705cfb86b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] HTTP exception thrown: Instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 could not be found. Aug 04 21:50:23.235281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d2339fe2-a801-42f3-bdc4-3dc705cfb86b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Request method failure captured: Aug 04 21:50:23.235281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 HTTP/1.1 Aug 04 21:50:23.235281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:50:23.235281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:50:23.235281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:50:23.235281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:50:23.235281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:50:23.235281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:50:23.235281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:50:23.235281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:50:23.235281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7DzKJTsJAHPDhJ8CMuf9KkeK11MhLOSHwTHX7vzm8TbfgcJVNWjadZ85KdKsVcHVvFkKn0cT0xu9ul8CaY82QzjSHg1WGhr5_hU-MhpmSf7GBIM8UkxIT8_GJsae52KTrCsFMxroACrk7UlCOx-g-7Paunx7vrjm8yxNgR1ylXRGvVw Aug 04 21:50:23.235281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:50:23.235281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:50:23.235281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:50:23.235281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:50:23.235281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:50:23.235281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:50:23.235281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: 09370df0a2354bd2a412c6770d3ff165 Aug 04 21:50:23.235281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-AttachVolumeTestJSON-1799315316 Aug 04 21:50:23.235281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:50:23.235281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:50:23.239857 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_09370df0a2354bd2a412c6770d3ff165", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/09370df0a2354bd2a412c6770d3ff165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/09370df0a2354bd2a412c6770d3ff165"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/09370df0a2354bd2a412c6770d3ff165"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:50:23.239857 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-AttachVolumeTestJSON-1799315316 Aug 04 21:50:23.239857 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: 09370df0a2354bd2a412c6770d3ff165 Aug 04 21:50:23.239857 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1799315316 Aug 04 21:50:23.239857 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-AttachVolumeTestJSON-1799315316-project Aug 04 21:50:23.239857 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:50:23.239857 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:50:23.239857 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: a23fcabad2354e7ab51a22b412bf11e6 Aug 04 21:50:23.239857 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-AttachVolumeTestJSON-1799315316-project Aug 04 21:50:23.239857 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:50:23.239857 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 could not be found. Aug 04 21:50:23.239857 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': 'ce7b7159-6eae-4d5b-916c-43e4a21a6f60'} Aug 04 21:50:23.242870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:50:23.242870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:50:23.242870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:50:23.242870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:50:23.242870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:50:23.242870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:50:23.242870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:50:23.242870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:50:23.242870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:50:23.242870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:50:23.242870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 could not be found. Aug 04 21:50:23.242870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:23.242870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:50:23.242870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:23.242870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:50:23.242870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:50:23.242870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:50:23.242870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:50:23.242870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:50:23.242870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:50:23.244768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:50:23.244768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:50:23.244768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:50:23.244768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:50:23.244768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:50:23.244768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:50:23.244768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:50:23.244768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 could not be found. Aug 04 21:50:23.244768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:23.244768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:50:23.244768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:23.244768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:50:23.244768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:50:23.244768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:50:23.244768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:50:23.244768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:50:23.244768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 could not be found. Aug 04 21:50:23.244768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:23.246122 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d2339fe2-a801-42f3-bdc4-3dc705cfb86b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Returning 404 to user: Instance ce7b7159-6eae-4d5b-916c-43e4a21a6f60 could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:50:23.246122 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d2339fe2-a801-42f3-bdc4-3dc705cfb86b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60" status: 404 len: 111 microversion: 2.1 time: 0.032047 Aug 04 21:50:23.246122 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 457/906] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:23 2022] GET /compute/v2.1/servers/ce7b7159-6eae-4d5b-916c-43e4a21a6f60 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:50:23.302544 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.multi_cell_list [None req-ac59af0e-ce03-4252-bdb5-6f6892fa57f4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136341) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 21:50:23.394649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ac59af0e-ce03-4252-bdb5-6f6892fa57f4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204663 Aug 04 21:50:23.395221 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 450/907] 10.222.0.73 () {58 vars in 1125 bytes} [Thu Aug 4 21:50:23 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:50:23.407414 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8c6a1498-f1e8-4326-8f45-4244ebb046c4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:23.408020 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8c6a1498-f1e8-4326-8f45-4244ebb046c4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:23.414744 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8c6a1498-f1e8-4326-8f45-4244ebb046c4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:23.415221 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8c6a1498-f1e8-4326-8f45-4244ebb046c4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:23.415654 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8c6a1498-f1e8-4326-8f45-4244ebb046c4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:23.416346 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8c6a1498-f1e8-4326-8f45-4244ebb046c4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:23.416795 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8c6a1498-f1e8-4326-8f45-4244ebb046c4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:23.417212 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8c6a1498-f1e8-4326-8f45-4244ebb046c4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:23.555352 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8c6a1498-f1e8-4326-8f45-4244ebb046c4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:23.563281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8c6a1498-f1e8-4326-8f45-4244ebb046c4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1550 microversion: 2.1 time: 0.159658 Aug 04 21:50:23.563787 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 458/908] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:23 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:24.513986 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-3ddeb5bd-5c63-4437-b67a-8cecec2e75e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:24.514520 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-3ddeb5bd-5c63-4437-b67a-8cecec2e75e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:24.521006 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3ddeb5bd-5c63-4437-b67a-8cecec2e75e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:24.521492 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3ddeb5bd-5c63-4437-b67a-8cecec2e75e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:24.521924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3ddeb5bd-5c63-4437-b67a-8cecec2e75e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:24.522692 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3ddeb5bd-5c63-4437-b67a-8cecec2e75e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:24.523101 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3ddeb5bd-5c63-4437-b67a-8cecec2e75e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:24.523556 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3ddeb5bd-5c63-4437-b67a-8cecec2e75e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:24.536796 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-3ddeb5bd-5c63-4437-b67a-8cecec2e75e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] HTTP exception thrown: Instance dbeea630-d67b-4f89-a329-c7066d506126 could not be found. Aug 04 21:50:24.538376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-3ddeb5bd-5c63-4437-b67a-8cecec2e75e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Request method failure captured: Aug 04 21:50:24.538376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: DELETE /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 HTTP/1.1 Aug 04 21:50:24.538376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:50:24.538376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:50:24.538376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:50:24.538376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 21:50:24.538376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:50:24.538376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:50:24.538376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:50:24.538376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:50:24.538376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7DzKJTsJAHPDhJ8CMuf9KkeK11MhLOSHwTHX7vzm8TbfgcJVNWjadZ85KdKsVcHVvFkKn0cT0xu9ul8CaY82QzjSHg1WGhr5_hU-MhpmSf7GBIM8UkxIT8_GJsae52KTrCsFMxroACrk7UlCOx-g-7Paunx7vrjm8yxNgR1ylXRGvVw Aug 04 21:50:24.538376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:50:24.538376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:50:24.538376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:50:24.538376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:50:24.538376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:50:24.538376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:50:24.538376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: 09370df0a2354bd2a412c6770d3ff165 Aug 04 21:50:24.538376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-AttachVolumeTestJSON-1799315316 Aug 04 21:50:24.538376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:50:24.538376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:50:24.539904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_09370df0a2354bd2a412c6770d3ff165", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/09370df0a2354bd2a412c6770d3ff165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/09370df0a2354bd2a412c6770d3ff165"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/09370df0a2354bd2a412c6770d3ff165"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:50:24.539904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-AttachVolumeTestJSON-1799315316 Aug 04 21:50:24.539904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: 09370df0a2354bd2a412c6770d3ff165 Aug 04 21:50:24.539904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1799315316 Aug 04 21:50:24.539904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-AttachVolumeTestJSON-1799315316-project Aug 04 21:50:24.539904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:50:24.539904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:50:24.539904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: a23fcabad2354e7ab51a22b412bf11e6 Aug 04 21:50:24.539904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-AttachVolumeTestJSON-1799315316-project Aug 04 21:50:24.539904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 21:50:24.539904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Instance dbeea630-d67b-4f89-a329-c7066d506126 could not be found. Aug 04 21:50:24.539904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': 'dbeea630-d67b-4f89-a329-c7066d506126'} Aug 04 21:50:24.540806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:50:24.540806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:50:24.540806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:50:24.540806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:50:24.540806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:50:24.540806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:50:24.540806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:50:24.540806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:50:24.540806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:50:24.540806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:50:24.540806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbeea630-d67b-4f89-a329-c7066d506126 could not be found. Aug 04 21:50:24.540806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:50:24.540806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:50:24.540806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:50:24.540806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:50:24.540806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:50:24.540806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:50:24.540806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:50:24.540806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:50:24.540806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:50:24.542247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:50:24.542247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:50:24.542247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:50:24.542247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:50:24.542247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:50:24.542247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:50:24.542247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:50:24.542247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:50:24.542247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:50:24.542247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbeea630-d67b-4f89-a329-c7066d506126 could not be found. Aug 04 21:50:24.542247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:50:24.542247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:50:24.542247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:50:24.542247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:50:24.542247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:50:24.542247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:50:24.542247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:50:24.542247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:50:24.542247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbeea630-d67b-4f89-a329-c7066d506126 could not be found. Aug 04 21:50:24.542247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:50:24.543696 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-3ddeb5bd-5c63-4437-b67a-8cecec2e75e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Returning 404 to user: Instance dbeea630-d67b-4f89-a329-c7066d506126 could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:50:24.543696 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-3ddeb5bd-5c63-4437-b67a-8cecec2e75e9 tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "DELETE /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 404 len: 111 microversion: 2.1 time: 0.029705 Aug 04 21:50:24.543696 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 451/909] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:50:24 2022] DELETE /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:50:24.548169 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6b111029-0dbf-40f6-ac46-0292e8b6992b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:24.548778 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-6b111029-0dbf-40f6-ac46-0292e8b6992b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] [instance: dbeea630-d67b-4f89-a329-c7066d506126] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:24.555917 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6b111029-0dbf-40f6-ac46-0292e8b6992b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:24.556400 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6b111029-0dbf-40f6-ac46-0292e8b6992b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:24.556834 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6b111029-0dbf-40f6-ac46-0292e8b6992b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:24.557518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6b111029-0dbf-40f6-ac46-0292e8b6992b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:24.557977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6b111029-0dbf-40f6-ac46-0292e8b6992b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:24.558422 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6b111029-0dbf-40f6-ac46-0292e8b6992b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:24.572993 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-6b111029-0dbf-40f6-ac46-0292e8b6992b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] HTTP exception thrown: Instance dbeea630-d67b-4f89-a329-c7066d506126 could not be found. Aug 04 21:50:24.574536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6b111029-0dbf-40f6-ac46-0292e8b6992b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Request method failure captured: Aug 04 21:50:24.574536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 HTTP/1.1 Aug 04 21:50:24.574536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:50:24.574536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:50:24.574536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:50:24.574536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:50:24.574536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:50:24.574536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:50:24.574536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:50:24.574536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:50:24.574536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7DzKJTsJAHPDhJ8CMuf9KkeK11MhLOSHwTHX7vzm8TbfgcJVNWjadZ85KdKsVcHVvFkKn0cT0xu9ul8CaY82QzjSHg1WGhr5_hU-MhpmSf7GBIM8UkxIT8_GJsae52KTrCsFMxroACrk7UlCOx-g-7Paunx7vrjm8yxNgR1ylXRGvVw Aug 04 21:50:24.574536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:50:24.574536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:50:24.574536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:50:24.574536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:50:24.574536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:50:24.574536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:50:24.574536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: 09370df0a2354bd2a412c6770d3ff165 Aug 04 21:50:24.574536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-AttachVolumeTestJSON-1799315316 Aug 04 21:50:24.574536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:50:24.574536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:50:24.576136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_09370df0a2354bd2a412c6770d3ff165", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/09370df0a2354bd2a412c6770d3ff165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/09370df0a2354bd2a412c6770d3ff165"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/09370df0a2354bd2a412c6770d3ff165"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:50:24.576136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-AttachVolumeTestJSON-1799315316 Aug 04 21:50:24.576136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: 09370df0a2354bd2a412c6770d3ff165 Aug 04 21:50:24.576136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1799315316 Aug 04 21:50:24.576136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-AttachVolumeTestJSON-1799315316-project Aug 04 21:50:24.576136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:50:24.576136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:50:24.576136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: a23fcabad2354e7ab51a22b412bf11e6 Aug 04 21:50:24.576136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-AttachVolumeTestJSON-1799315316-project Aug 04 21:50:24.576136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:50:24.576136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance dbeea630-d67b-4f89-a329-c7066d506126 could not be found. Aug 04 21:50:24.576136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': 'dbeea630-d67b-4f89-a329-c7066d506126'} Aug 04 21:50:24.576977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:50:24.576977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:50:24.576977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:50:24.576977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:50:24.576977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:50:24.576977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:50:24.576977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:50:24.576977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:50:24.576977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:50:24.576977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:50:24.576977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbeea630-d67b-4f89-a329-c7066d506126 could not be found. Aug 04 21:50:24.576977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:24.576977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:50:24.576977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:24.576977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:50:24.576977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:50:24.576977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:50:24.576977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:50:24.576977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:50:24.576977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:50:24.578441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:50:24.578441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:50:24.578441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:50:24.578441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:50:24.578441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:50:24.578441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:50:24.578441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:50:24.578441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbeea630-d67b-4f89-a329-c7066d506126 could not be found. Aug 04 21:50:24.578441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:24.578441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:50:24.578441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:24.578441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:50:24.578441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:50:24.578441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:50:24.578441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:50:24.578441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:50:24.578441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbeea630-d67b-4f89-a329-c7066d506126 could not be found. Aug 04 21:50:24.578441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:24.579724 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6b111029-0dbf-40f6-ac46-0292e8b6992b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] Returning 404 to user: Instance dbeea630-d67b-4f89-a329-c7066d506126 could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:50:24.579724 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-6b111029-0dbf-40f6-ac46-0292e8b6992b tempest-AttachVolumeTestJSON-1799315316 tempest-AttachVolumeTestJSON-1799315316-project] 10.222.0.73 "GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126" status: 404 len: 111 microversion: 2.1 time: 0.031573 Aug 04 21:50:24.579724 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 459/910] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:24 2022] GET /compute/v2.1/servers/dbeea630-d67b-4f89-a329-c7066d506126 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:50:25.445198 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-9b7a96cd-d47e-4528-ac28-f4a3cc0cc3e7 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4de2fd67-3734-4c79-869a-f1500158d6e0"}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:50:25.447567 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-9b7a96cd-d47e-4528-ac28-f4a3cc0cc3e7 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:25.453584 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9b7a96cd-d47e-4528-ac28-f4a3cc0cc3e7 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:25.454086 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9b7a96cd-d47e-4528-ac28-f4a3cc0cc3e7 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:25.454516 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9b7a96cd-d47e-4528-ac28-f4a3cc0cc3e7 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:25.455244 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9b7a96cd-d47e-4528-ac28-f4a3cc0cc3e7 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:25.455691 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9b7a96cd-d47e-4528-ac28-f4a3cc0cc3e7 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:25.456105 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9b7a96cd-d47e-4528-ac28-f4a3cc0cc3e7 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:26.162098 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-9b7a96cd-d47e-4528-ac28-f4a3cc0cc3e7 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "POST /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.720281 Aug 04 21:50:26.163053 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 452/911] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 4 21:50:25 2022] POST /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28/os-volume_attachments => generated 194 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:50:27.511590 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:50:27.512216 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Thu Aug 4 21:50:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:50:30.205082 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-877428ad-5138-4ad5-be12-b08a5999ec03 tempest-VolumesGetTestJSON-595447703 tempest-VolumesGetTestJSON-595447703-project] Action: 'create', calling method: .version_select at 0x7f3c11343c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-912605603", "metadata": {"Type": "work"}}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:50:30.789562 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-877428ad-5138-4ad5-be12-b08a5999ec03 tempest-VolumesGetTestJSON-595447703 tempest-VolumesGetTestJSON-595447703-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.697422 Aug 04 21:50:30.790229 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 460/912] 10.222.0.73 () {60 vars in 1156 bytes} [Thu Aug 4 21:50:30 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 699 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 21:50:30.804757 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-fe0e2bea-0de8-4a2a-907f-9dbfc9e09be0 tempest-VolumesGetTestJSON-595447703 tempest-VolumesGetTestJSON-595447703-project] Calling method '.version_select at 0x7f3c10723e50>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:30.859904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-fe0e2bea-0de8-4a2a-907f-9dbfc9e09be0 tempest-VolumesGetTestJSON-595447703 tempest-VolumesGetTestJSON-595447703-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/d14c9cb8-769a-432f-81c2-be4a8c42cc73" status: 200 len: 352 microversion: 2.1 time: 0.060381 Aug 04 21:50:30.864718 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 453/913] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 4 21:50:30 2022] GET /compute/v2.1/os-volumes/d14c9cb8-769a-432f-81c2-be4a8c42cc73 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:50:31.875871 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8aec5107-a38e-45cb-a9f3-6fbe10005545 tempest-VolumesGetTestJSON-595447703 tempest-VolumesGetTestJSON-595447703-project] Calling method '.version_select at 0x7f3c1063fdc0>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:31.923904 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8aec5107-a38e-45cb-a9f3-6fbe10005545 tempest-VolumesGetTestJSON-595447703 tempest-VolumesGetTestJSON-595447703-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/d14c9cb8-769a-432f-81c2-be4a8c42cc73" status: 200 len: 353 microversion: 2.1 time: 0.052839 Aug 04 21:50:31.924610 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 461/914] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 4 21:50:31 2022] GET /compute/v2.1/os-volumes/d14c9cb8-769a-432f-81c2-be4a8c42cc73 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:50:31.938377 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-99cbc304-a74b-4ecf-9f56-e748abfa9de5 tempest-VolumesGetTestJSON-595447703 tempest-VolumesGetTestJSON-595447703-project] Calling method '.version_select at 0x7f3c10530820>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:31.987380 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-99cbc304-a74b-4ecf-9f56-e748abfa9de5 tempest-VolumesGetTestJSON-595447703 tempest-VolumesGetTestJSON-595447703-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/d14c9cb8-769a-432f-81c2-be4a8c42cc73" status: 200 len: 353 microversion: 2.1 time: 0.053519 Aug 04 21:50:31.987954 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 454/915] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 4 21:50:31 2022] GET /compute/v2.1/os-volumes/d14c9cb8-769a-432f-81c2-be4a8c42cc73 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:50:32.006918 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-47782b3c-86cb-4105-a322-1c37cc5a8e58 tempest-VolumesGetTestJSON-595447703 tempest-VolumesGetTestJSON-595447703-project] Calling method '.version_select at 0x7f3c14f8aaf0>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:32.185148 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-47782b3c-86cb-4105-a322-1c37cc5a8e58 tempest-VolumesGetTestJSON-595447703 tempest-VolumesGetTestJSON-595447703-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/d14c9cb8-769a-432f-81c2-be4a8c42cc73" status: 202 len: 0 microversion: 2.1 time: 0.182641 Aug 04 21:50:32.185711 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 462/916] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 4 21:50:32 2022] DELETE /compute/v2.1/os-volumes/d14c9cb8-769a-432f-81c2-be4a8c42cc73 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:50:32.194080 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-7fd97ec2-e3bc-4c20-8630-bdd18bb46374 tempest-VolumesGetTestJSON-595447703 tempest-VolumesGetTestJSON-595447703-project] Calling method '.version_select at 0x7f3c10723280>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:32.241867 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-7fd97ec2-e3bc-4c20-8630-bdd18bb46374 tempest-VolumesGetTestJSON-595447703 tempest-VolumesGetTestJSON-595447703-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/d14c9cb8-769a-432f-81c2-be4a8c42cc73" status: 200 len: 352 microversion: 2.1 time: 0.051822 Aug 04 21:50:32.242474 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 455/917] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 4 21:50:32 2022] GET /compute/v2.1/os-volumes/d14c9cb8-769a-432f-81c2-be4a8c42cc73 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:50:33.256006 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-faec6caf-1a22-40cd-aab4-08610ac66d92 tempest-VolumesGetTestJSON-595447703 tempest-VolumesGetTestJSON-595447703-project] Calling method '.version_select at 0x7f3c14fddd30>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:33.284445 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-faec6caf-1a22-40cd-aab4-08610ac66d92 tempest-VolumesGetTestJSON-595447703 tempest-VolumesGetTestJSON-595447703-project] HTTP exception thrown: Volume d14c9cb8-769a-432f-81c2-be4a8c42cc73 could not be found. Aug 04 21:50:33.286588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-faec6caf-1a22-40cd-aab4-08610ac66d92 tempest-VolumesGetTestJSON-595447703 tempest-VolumesGetTestJSON-595447703-project] Request method failure captured: Aug 04 21:50:33.286588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: GET /compute/v2.1/os-volumes/d14c9cb8-769a-432f-81c2-be4a8c42cc73 HTTP/1.1 Aug 04 21:50:33.286588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:50:33.286588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:50:33.286588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:50:33.286588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:50:33.286588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:50:33.286588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:50:33.286588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:50:33.286588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:50:33.286588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7D8mmDyzJCQd0updYfg5oNKAspMiO3IefgTbBByoexEoPpcHVUhUT9mRa32bOzpyZeEhyW3ml_dB3tV1SgeLEhB4GnbCoenItrXkK4smwscrA8dqENxA12j2jy_wYMFEvQlFVEl7n7j4mDIPvnEd-K-cPZAeEHPKeyNdAm4tSBVzGkY Aug 04 21:50:33.286588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:50:33.286588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:50:33.286588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:50:33.286588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:50:33.286588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:50:33.286588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:50:33.286588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: 55666f6e2a9240389068279a71d32a1c Aug 04 21:50:33.286588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-VolumesGetTestJSON-595447703 Aug 04 21:50:33.286588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:50:33.286588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:50:33.288653 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_55666f6e2a9240389068279a71d32a1c", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/55666f6e2a9240389068279a71d32a1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/55666f6e2a9240389068279a71d32a1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/55666f6e2a9240389068279a71d32a1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:50:33.288653 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-VolumesGetTestJSON-595447703 Aug 04 21:50:33.288653 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: 55666f6e2a9240389068279a71d32a1c Aug 04 21:50:33.288653 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-VolumesGetTestJSON-595447703 Aug 04 21:50:33.288653 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-VolumesGetTestJSON-595447703-project Aug 04 21:50:33.288653 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:50:33.288653 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:50:33.288653 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: 0e5927bdd755425ca37db47fc1cbad41 Aug 04 21:50:33.288653 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-VolumesGetTestJSON-595447703-project Aug 04 21:50:33.288653 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: Aug 04 21:50:33.288653 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Volume d14c9cb8-769a-432f-81c2-be4a8c42cc73 could not be found. Aug 04 21:50:33.288653 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': 'd14c9cb8-769a-432f-81c2-be4a8c42cc73'} Aug 04 21:50:33.288653 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:50:33.289774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:50:33.289774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:50:33.289774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:50:33.289774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:50:33.289774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:50:33.289774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:50:33.289774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:50:33.289774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:50:33.289774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:50:33.289774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:50:33.289774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:50:33.289774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:50:33.289774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:50:33.289774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:50:33.289774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:50:33.289774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d14c9cb8-769a-432f-81c2-be4a8c42cc73 could not be found. (HTTP 404) (Request-ID: req-a0789ae0-9cd9-447e-8665-318e8ee1910f) Aug 04 21:50:33.289774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:33.289774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:50:33.289774 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:33.291294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:50:33.291294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 21:50:33.291294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 21:50:33.291294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:50:33.291294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:50:33.291294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 21:50:33.291294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 21:50:33.291294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:50:33.291294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:50:33.291294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:50:33.291294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:50:33.291294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:50:33.291294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:50:33.291294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:50:33.291294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:50:33.291294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:50:33.291294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:50:33.291294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:50:33.291294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:50:33.293197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:50:33.293197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:50:33.293197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:50:33.293197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:50:33.293197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d14c9cb8-769a-432f-81c2-be4a8c42cc73 could not be found. Aug 04 21:50:33.293197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:33.293197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:50:33.293197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:33.293197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:50:33.293197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:50:33.293197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:50:33.293197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:50:33.293197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:50:33.293197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:50:33.293197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:50:33.293197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:50:33.293197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:50:33.293197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 21:50:33.293197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:50:33.294677 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d14c9cb8-769a-432f-81c2-be4a8c42cc73 could not be found. Aug 04 21:50:33.294677 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:33.294677 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:50:33.294677 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:33.294677 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:50:33.294677 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:50:33.294677 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:50:33.294677 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:50:33.294677 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:50:33.294677 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d14c9cb8-769a-432f-81c2-be4a8c42cc73 could not be found. Aug 04 21:50:33.294677 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:50:33.294677 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-faec6caf-1a22-40cd-aab4-08610ac66d92 tempest-VolumesGetTestJSON-595447703 tempest-VolumesGetTestJSON-595447703-project] Returning 404 to user: Volume d14c9cb8-769a-432f-81c2-be4a8c42cc73 could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:50:33.294677 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-faec6caf-1a22-40cd-aab4-08610ac66d92 tempest-VolumesGetTestJSON-595447703 tempest-VolumesGetTestJSON-595447703-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/d14c9cb8-769a-432f-81c2-be4a8c42cc73" status: 404 len: 109 microversion: 2.1 time: 0.037151 Aug 04 21:50:33.294677 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 463/918] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 4 21:50:33 2022] GET /compute/v2.1/os-volumes/d14c9cb8-769a-432f-81c2-be4a8c42cc73 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:50:34.813745 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=2 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:50:34.817842 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-13bd4284-14d1-476f-8bf2-9714dc92c155 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:34.818619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-13bd4284-14d1-476f-8bf2-9714dc92c155 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:34.821323 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:50:34.826184 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-13bd4284-14d1-476f-8bf2-9714dc92c155 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:34.826658 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-13bd4284-14d1-476f-8bf2-9714dc92c155 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:34.827751 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-13bd4284-14d1-476f-8bf2-9714dc92c155 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:34.828651 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-13bd4284-14d1-476f-8bf2-9714dc92c155 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:34.829101 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-13bd4284-14d1-476f-8bf2-9714dc92c155 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:34.829519 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-13bd4284-14d1-476f-8bf2-9714dc92c155 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:34.965527 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-13bd4284-14d1-476f-8bf2-9714dc92c155 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:34.973642 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-13bd4284-14d1-476f-8bf2-9714dc92c155 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1596 microversion: 2.1 time: 0.160980 Aug 04 21:50:34.974233 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 456/919] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:34 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1596 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:50:37.214463 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-21b95dec-e107-41e6-af4a-0c7411a86943 req-e3c4b302-f056-45a8-a979-5527a40b6315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b239b668-0156-411a-8a3b-45ce0c119e28", "tag": "85083dfa-01f6-49d9-a92d-4bfee46f59b9"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:50:37.228613 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:50:37.229634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=9 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:50:37.232731 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-21b95dec-e107-41e6-af4a-0c7411a86943 req-e3c4b302-f056-45a8-a979-5527a40b6315 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:37.233268 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-21b95dec-e107-41e6-af4a-0c7411a86943 req-e3c4b302-f056-45a8-a979-5527a40b6315 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:37.233767 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-21b95dec-e107-41e6-af4a-0c7411a86943 req-e3c4b302-f056-45a8-a979-5527a40b6315 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:37.247790 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-21b95dec-e107-41e6-af4a-0c7411a86943 req-e3c4b302-f056-45a8-a979-5527a40b6315 service nova] Creating event network-changed:85083dfa-01f6-49d9-a92d-4bfee46f59b9 for instance b239b668-0156-411a-8a3b-45ce0c119e28 on hv-cinder-85220 Aug 04 21:50:37.253633 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-21b95dec-e107-41e6-af4a-0c7411a86943 req-e3c4b302-f056-45a8-a979-5527a40b6315 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046732 Aug 04 21:50:37.254753 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 464/920] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:50:39.884152 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-87d31f8b-39c7-4a47-817b-fc3f32a33168 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-502840871"}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:50:39.884800 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-87d31f8b-39c7-4a47-817b-fc3f32a33168 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:39.891547 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-87d31f8b-39c7-4a47-817b-fc3f32a33168 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:39.892323 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-87d31f8b-39c7-4a47-817b-fc3f32a33168 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:39.892755 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-87d31f8b-39c7-4a47-817b-fc3f32a33168 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:39.893456 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-87d31f8b-39c7-4a47-817b-fc3f32a33168 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:39.893899 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-87d31f8b-39c7-4a47-817b-fc3f32a33168 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:39.894350 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-87d31f8b-39c7-4a47-817b-fc3f32a33168 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:40.031336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.network.security_group_api [None req-87d31f8b-39c7-4a47-817b-fc3f32a33168 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Adding security group 0d1f37aa-6359-47cb-995a-898bdb479595 to port 85083dfa-01f6-49d9-a92d-4bfee46f59b9 Aug 04 21:50:40.453255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-87d31f8b-39c7-4a47-817b-fc3f32a33168 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "POST /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28/action" status: 202 len: 0 microversion: 2.1 time: 0.574346 Aug 04 21:50:40.454057 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 457/921] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 4 21:50:39 2022] POST /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:50:40.474558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b4c7ea8f-2ca6-47f3-83ff-9b37a5031635 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:50:40.475617 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-d21814e9-b596-46a1-8035-6cf55ee7bfab req-4520c8a0-42c4-4579-8413-f1172845a302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b239b668-0156-411a-8a3b-45ce0c119e28", "tag": "85083dfa-01f6-49d9-a92d-4bfee46f59b9"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:50:40.478565 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b4c7ea8f-2ca6-47f3-83ff-9b37a5031635 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:50:40.492192 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b4c7ea8f-2ca6-47f3-83ff-9b37a5031635 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:40.494543 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b4c7ea8f-2ca6-47f3-83ff-9b37a5031635 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:40.494970 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b4c7ea8f-2ca6-47f3-83ff-9b37a5031635 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:40.498723 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b4c7ea8f-2ca6-47f3-83ff-9b37a5031635 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:40.499713 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-d21814e9-b596-46a1-8035-6cf55ee7bfab req-4520c8a0-42c4-4579-8413-f1172845a302 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:50:40.500369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b4c7ea8f-2ca6-47f3-83ff-9b37a5031635 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:40.501002 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b4c7ea8f-2ca6-47f3-83ff-9b37a5031635 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:40.501725 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-d21814e9-b596-46a1-8035-6cf55ee7bfab req-4520c8a0-42c4-4579-8413-f1172845a302 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:50:40.503819 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-d21814e9-b596-46a1-8035-6cf55ee7bfab req-4520c8a0-42c4-4579-8413-f1172845a302 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:50:40.537124 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-d21814e9-b596-46a1-8035-6cf55ee7bfab req-4520c8a0-42c4-4579-8413-f1172845a302 service nova] Creating event network-changed:85083dfa-01f6-49d9-a92d-4bfee46f59b9 for instance b239b668-0156-411a-8a3b-45ce0c119e28 on hv-cinder-85220 Aug 04 21:50:40.544743 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-d21814e9-b596-46a1-8035-6cf55ee7bfab req-4520c8a0-42c4-4579-8413-f1172845a302 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081944 Aug 04 21:50:40.549180 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 458/922] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:50:40.776924 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b4c7ea8f-2ca6-47f3-83ff-9b37a5031635 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:50:40.785110 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b4c7ea8f-2ca6-47f3-83ff-9b37a5031635 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1760 microversion: 2.1 time: 0.326677 Aug 04 21:50:40.799769 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 465/923] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:50:40 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1760 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:19.849051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=5 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:51:19.849805 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:51:19.854163 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-6a7eb966-14eb-44f0-bd49-ff3899c4bb22 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:19.856467 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-6a7eb966-14eb-44f0-bd49-ff3899c4bb22 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:19.862435 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6a7eb966-14eb-44f0-bd49-ff3899c4bb22 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:19.862939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6a7eb966-14eb-44f0-bd49-ff3899c4bb22 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:19.863379 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6a7eb966-14eb-44f0-bd49-ff3899c4bb22 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:19.864076 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6a7eb966-14eb-44f0-bd49-ff3899c4bb22 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:19.864529 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6a7eb966-14eb-44f0-bd49-ff3899c4bb22 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:19.864952 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6a7eb966-14eb-44f0-bd49-ff3899c4bb22 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:19.895662 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-6a7eb966-14eb-44f0-bd49-ff3899c4bb22 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047984 Aug 04 21:51:19.896235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 459/924] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 4 21:51:19 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:19.965357 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2960ef6f-4f6c-4402-88e3-3a4446542d38 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:19.965938 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2960ef6f-4f6c-4402-88e3-3a4446542d38 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:19.968192 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=4 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:51:19.968839 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=8 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:51:19.978128 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2960ef6f-4f6c-4402-88e3-3a4446542d38 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:19.978614 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2960ef6f-4f6c-4402-88e3-3a4446542d38 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:19.979040 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2960ef6f-4f6c-4402-88e3-3a4446542d38 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:19.979732 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2960ef6f-4f6c-4402-88e3-3a4446542d38 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:19.980183 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2960ef6f-4f6c-4402-88e3-3a4446542d38 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:19.980603 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2960ef6f-4f6c-4402-88e3-3a4446542d38 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:20.011398 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2960ef6f-4f6c-4402-88e3-3a4446542d38 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Going to try to terminate instance {{(pid=136342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:51:20.385655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2960ef6f-4f6c-4402-88e3-3a4446542d38 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "DELETE /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 204 len: 0 microversion: 2.20 time: 0.425323 Aug 04 21:51:20.386295 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 466/925] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 4 21:51:19 2022] DELETE /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 21:51:20.395278 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c37fd7ea-e975-442a-a23c-e41bd3549e43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:20.395895 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c37fd7ea-e975-442a-a23c-e41bd3549e43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:20.402510 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c37fd7ea-e975-442a-a23c-e41bd3549e43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:20.402983 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c37fd7ea-e975-442a-a23c-e41bd3549e43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:20.403404 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c37fd7ea-e975-442a-a23c-e41bd3549e43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:20.404079 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c37fd7ea-e975-442a-a23c-e41bd3549e43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:20.404522 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c37fd7ea-e975-442a-a23c-e41bd3549e43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:20.404936 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c37fd7ea-e975-442a-a23c-e41bd3549e43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:20.542708 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-c37fd7ea-e975-442a-a23c-e41bd3549e43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:20.550790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-c37fd7ea-e975-442a-a23c-e41bd3549e43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:20.552242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-c37fd7ea-e975-442a-a23c-e41bd3549e43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:20.553415 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c37fd7ea-e975-442a-a23c-e41bd3549e43 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1723 microversion: 2.20 time: 0.162791 Aug 04 21:51:20.553979 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 460/926] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:51:20 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:51:21.578814 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-db1dc429-9692-4b6d-9792-2510997230ed tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:21.579635 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-db1dc429-9692-4b6d-9792-2510997230ed tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:21.586088 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-db1dc429-9692-4b6d-9792-2510997230ed tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:21.586883 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-db1dc429-9692-4b6d-9792-2510997230ed tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:21.587056 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-db1dc429-9692-4b6d-9792-2510997230ed tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:21.587752 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-db1dc429-9692-4b6d-9792-2510997230ed tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:21.589252 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-db1dc429-9692-4b6d-9792-2510997230ed tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:21.589734 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-db1dc429-9692-4b6d-9792-2510997230ed tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:21.726000 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-db1dc429-9692-4b6d-9792-2510997230ed tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:21.734890 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-db1dc429-9692-4b6d-9792-2510997230ed tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:21.736534 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-db1dc429-9692-4b6d-9792-2510997230ed tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:21.737694 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-db1dc429-9692-4b6d-9792-2510997230ed tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1723 microversion: 2.20 time: 0.163388 Aug 04 21:51:21.738324 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 467/927] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:51:21 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:51:22.762951 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-57081d32-2695-431c-9517-9d266cb71ebd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:22.763550 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-57081d32-2695-431c-9517-9d266cb71ebd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:22.770271 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-57081d32-2695-431c-9517-9d266cb71ebd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:22.770750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-57081d32-2695-431c-9517-9d266cb71ebd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:22.771188 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-57081d32-2695-431c-9517-9d266cb71ebd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:22.771870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-57081d32-2695-431c-9517-9d266cb71ebd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:22.772312 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-57081d32-2695-431c-9517-9d266cb71ebd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:22.772725 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-57081d32-2695-431c-9517-9d266cb71ebd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:22.910460 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-57081d32-2695-431c-9517-9d266cb71ebd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:22.953839 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-57081d32-2695-431c-9517-9d266cb71ebd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:22.953839 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-57081d32-2695-431c-9517-9d266cb71ebd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:22.953839 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-57081d32-2695-431c-9517-9d266cb71ebd tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1723 microversion: 2.20 time: 0.167799 Aug 04 21:51:22.954478 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 461/928] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:51:22 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:51:23.192129 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-5ea1b798-2598-4b29-9bef-5fbd4a0edd5c req-870add1f-654e-4839-9c4b-3e7bc837c4ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6a3daf-6b19-47d0-85ca-eed1eacb91ca", "name": "network-vif-deleted", "tag": "0748a24c-fd32-415e-bade-f491bfffbd57"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:51:23.202290 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-5ea1b798-2598-4b29-9bef-5fbd4a0edd5c req-870add1f-654e-4839-9c4b-3e7bc837c4ff service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:23.202769 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-5ea1b798-2598-4b29-9bef-5fbd4a0edd5c req-870add1f-654e-4839-9c4b-3e7bc837c4ff service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:23.203188 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-5ea1b798-2598-4b29-9bef-5fbd4a0edd5c req-870add1f-654e-4839-9c4b-3e7bc837c4ff service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:23.216094 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-5ea1b798-2598-4b29-9bef-5fbd4a0edd5c req-870add1f-654e-4839-9c4b-3e7bc837c4ff service nova] Creating event network-vif-deleted:0748a24c-fd32-415e-bade-f491bfffbd57 for instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca on hv-cinder-85220 Aug 04 21:51:23.221247 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-5ea1b798-2598-4b29-9bef-5fbd4a0edd5c req-870add1f-654e-4839-9c4b-3e7bc837c4ff service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032829 Aug 04 21:51:23.221834 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 468/929] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:51:23.949277 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-df72afd7-0efc-426f-987a-b07212ae76b0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:23.949919 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-df72afd7-0efc-426f-987a-b07212ae76b0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:23.956674 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-df72afd7-0efc-426f-987a-b07212ae76b0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:23.957170 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-df72afd7-0efc-426f-987a-b07212ae76b0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:23.957619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-df72afd7-0efc-426f-987a-b07212ae76b0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:23.958391 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-df72afd7-0efc-426f-987a-b07212ae76b0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:23.958849 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-df72afd7-0efc-426f-987a-b07212ae76b0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:23.959285 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-df72afd7-0efc-426f-987a-b07212ae76b0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:23.993755 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-df72afd7-0efc-426f-987a-b07212ae76b0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:23.994326 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-df72afd7-0efc-426f-987a-b07212ae76b0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:23.994765 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-df72afd7-0efc-426f-987a-b07212ae76b0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:23.995238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.objects.instance [None req-df72afd7-0efc-426f-987a-b07212ae76b0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lazy-loading 'fault' on Instance uuid 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca {{(pid=136341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:51:24.042552 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-df72afd7-0efc-426f-987a-b07212ae76b0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:24.050963 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-df72afd7-0efc-426f-987a-b07212ae76b0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:24.052401 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-df72afd7-0efc-426f-987a-b07212ae76b0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95fb2edf82644e7f8ce461fcbb52007b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b95ce24a4d34e379fa86c9114ece400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:24.053573 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-df72afd7-0efc-426f-987a-b07212ae76b0 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 200 len: 1372 microversion: 2.20 time: 0.108585 Aug 04 21:51:24.054159 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 462/930] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:51:23 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:51:25.080263 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b52ea92f-57eb-4b24-b32a-20b28cd77fd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:25.081200 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b52ea92f-57eb-4b24-b32a-20b28cd77fd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:25.087082 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b52ea92f-57eb-4b24-b32a-20b28cd77fd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:25.087552 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b52ea92f-57eb-4b24-b32a-20b28cd77fd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:25.088139 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b52ea92f-57eb-4b24-b32a-20b28cd77fd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:25.088909 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b52ea92f-57eb-4b24-b32a-20b28cd77fd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:25.089356 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b52ea92f-57eb-4b24-b32a-20b28cd77fd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:25.089780 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b52ea92f-57eb-4b24-b32a-20b28cd77fd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:25.103243 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-b52ea92f-57eb-4b24-b32a-20b28cd77fd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] HTTP exception thrown: Instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca could not be found. Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b52ea92f-57eb-4b24-b32a-20b28cd77fd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Request method failure captured: Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca HTTP/1.1 Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7DzPBxDeOlTeT9BvnBMwEXrSxDm73hCt0hOs_FK-5ilkHyxmcwQj6NdZ5D5SFUhulh-8PvLB1pZ8-Jgg8W7XJw9xdjtn0MTb9pVSZ4Fq28GPc5yXgUKRG3B1oa1JlAo1jvNLkW2SCltjIZZczWIX_Cp-UtnI0tOtCJLxgUisUCsTyqA Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: 4b95ce24a4d34e379fa86c9114ece400 Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-703997672 Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:51:25.105656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:51:25.107480 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4b95ce24a4d34e379fa86c9114ece400", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4b95ce24a4d34e379fa86c9114ece400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4b95ce24a4d34e379fa86c9114ece400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4b95ce24a4d34e379fa86c9114ece400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:51:25.107480 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-AttachVolumeShelveTestJSON-703997672 Aug 04 21:51:25.107480 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: 4b95ce24a4d34e379fa86c9114ece400 Aug 04 21:51:25.107480 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-703997672 Aug 04 21:51:25.107480 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-AttachVolumeShelveTestJSON-703997672-project Aug 04 21:51:25.107480 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:51:25.107480 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:51:25.107480 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: 95fb2edf82644e7f8ce461fcbb52007b Aug 04 21:51:25.107480 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-AttachVolumeShelveTestJSON-703997672-project Aug 04 21:51:25.107480 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:51:25.107480 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca could not be found. Aug 04 21:51:25.107480 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': '4a6a3daf-6b19-47d0-85ca-eed1eacb91ca'} Aug 04 21:51:25.108436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:51:25.108436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:51:25.108436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:51:25.108436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:51:25.108436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:51:25.108436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:51:25.108436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:51:25.108436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:51:25.108436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:51:25.108436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:51:25.108436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca could not be found. Aug 04 21:51:25.108436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:51:25.108436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:51:25.108436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:51:25.108436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:51:25.108436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:51:25.108436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:51:25.108436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:51:25.108436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:51:25.108436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:51:25.110206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:51:25.110206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:51:25.110206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:51:25.110206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:51:25.110206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:51:25.110206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:51:25.110206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:51:25.110206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca could not be found. Aug 04 21:51:25.110206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:51:25.110206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:51:25.110206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:51:25.110206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:51:25.110206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:51:25.110206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:51:25.110206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:51:25.110206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:51:25.110206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca could not be found. Aug 04 21:51:25.110206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:51:25.116901 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b52ea92f-57eb-4b24-b32a-20b28cd77fd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Returning 404 to user: Instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:51:25.116901 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b52ea92f-57eb-4b24-b32a-20b28cd77fd4 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 404 len: 111 microversion: 2.20 time: 0.031701 Aug 04 21:51:25.116901 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 469/931] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:51:25 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:51:25.117161 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f537d630-ac78-47ad-b9d9-0ebdcc0644be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '.version_select at 0x7f3c105ac550>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:25.186114 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f537d630-ac78-47ad-b9d9-0ebdcc0644be tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176136291" status: 204 len: 0 microversion: 2.20 time: 0.073646 Aug 04 21:51:25.186694 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 463/932] 10.222.0.73 () {60 vars in 1262 bytes} [Thu Aug 4 21:51:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176136291 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 21:51:27.361258 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-fcb64b8c-7162-4d1d-b406-18f73dbf7890 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:27.361797 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-fcb64b8c-7162-4d1d-b406-18f73dbf7890 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:27.368228 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fcb64b8c-7162-4d1d-b406-18f73dbf7890 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:27.368710 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fcb64b8c-7162-4d1d-b406-18f73dbf7890 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:27.369175 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fcb64b8c-7162-4d1d-b406-18f73dbf7890 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:27.369860 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fcb64b8c-7162-4d1d-b406-18f73dbf7890 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:27.370339 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fcb64b8c-7162-4d1d-b406-18f73dbf7890 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:27.370766 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fcb64b8c-7162-4d1d-b406-18f73dbf7890 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:27.384355 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-fcb64b8c-7162-4d1d-b406-18f73dbf7890 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] HTTP exception thrown: Instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca could not be found. Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-fcb64b8c-7162-4d1d-b406-18f73dbf7890 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Request method failure captured: Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: DELETE /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca HTTP/1.1 Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7DzPBxDeOlTeT9BvnBMwEXrSxDm73hCt0hOs_FK-5ilkHyxmcwQj6NdZ5D5SFUhulh-8PvLB1pZ8-Jgg8W7XJw9xdjtn0MTb9pVSZ4Fq28GPc5yXgUKRG3B1oa1JlAo1jvNLkW2SCltjIZZczWIX_Cp-UtnI0tOtCJLxgUisUCsTyqA Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: 4b95ce24a4d34e379fa86c9114ece400 Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-703997672 Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:51:27.386621 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:51:27.388087 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4b95ce24a4d34e379fa86c9114ece400", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4b95ce24a4d34e379fa86c9114ece400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4b95ce24a4d34e379fa86c9114ece400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4b95ce24a4d34e379fa86c9114ece400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:51:27.388087 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-AttachVolumeShelveTestJSON-703997672 Aug 04 21:51:27.388087 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: 4b95ce24a4d34e379fa86c9114ece400 Aug 04 21:51:27.388087 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-703997672 Aug 04 21:51:27.388087 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-AttachVolumeShelveTestJSON-703997672-project Aug 04 21:51:27.388087 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:51:27.388087 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:51:27.388087 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: 95fb2edf82644e7f8ce461fcbb52007b Aug 04 21:51:27.388087 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-AttachVolumeShelveTestJSON-703997672-project Aug 04 21:51:27.388087 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:51:27.388087 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca could not be found. Aug 04 21:51:27.388087 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': '4a6a3daf-6b19-47d0-85ca-eed1eacb91ca'} Aug 04 21:51:27.389323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:51:27.389323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:51:27.389323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:51:27.389323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:51:27.389323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:51:27.389323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:51:27.389323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:51:27.389323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:51:27.389323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:51:27.389323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:51:27.389323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca could not be found. Aug 04 21:51:27.389323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:51:27.389323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:51:27.389323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:51:27.389323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:51:27.389323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:51:27.389323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:51:27.389323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:51:27.389323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:51:27.389323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:51:27.391420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:51:27.391420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:51:27.391420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:51:27.391420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:51:27.391420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:51:27.391420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:51:27.391420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:51:27.391420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:51:27.391420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:51:27.391420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca could not be found. Aug 04 21:51:27.391420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:51:27.391420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:51:27.391420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:51:27.391420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:51:27.391420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:51:27.391420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:51:27.391420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:51:27.391420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:51:27.391420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca could not be found. Aug 04 21:51:27.391420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:51:27.392930 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-fcb64b8c-7162-4d1d-b406-18f73dbf7890 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Returning 404 to user: Instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:51:27.392930 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-fcb64b8c-7162-4d1d-b406-18f73dbf7890 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "DELETE /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 404 len: 111 microversion: 2.20 time: 0.030668 Aug 04 21:51:27.392930 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 470/933] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 4 21:51:27 2022] DELETE /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:51:27.396440 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-8e8935f5-708f-40b0-a45a-eb2829b33136 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:27.397045 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-8e8935f5-708f-40b0-a45a-eb2829b33136 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:27.404976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8e8935f5-708f-40b0-a45a-eb2829b33136 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:27.405456 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8e8935f5-708f-40b0-a45a-eb2829b33136 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:27.405879 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8e8935f5-708f-40b0-a45a-eb2829b33136 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:27.406762 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8e8935f5-708f-40b0-a45a-eb2829b33136 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:27.407204 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8e8935f5-708f-40b0-a45a-eb2829b33136 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:27.407618 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8e8935f5-708f-40b0-a45a-eb2829b33136 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:27.422059 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-8e8935f5-708f-40b0-a45a-eb2829b33136 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] HTTP exception thrown: Instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca could not be found. Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-8e8935f5-708f-40b0-a45a-eb2829b33136 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Request method failure captured: Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca HTTP/1.1 Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7DzPBxDeOlTeT9BvnBMwEXrSxDm73hCt0hOs_FK-5ilkHyxmcwQj6NdZ5D5SFUhulh-8PvLB1pZ8-Jgg8W7XJw9xdjtn0MTb9pVSZ4Fq28GPc5yXgUKRG3B1oa1JlAo1jvNLkW2SCltjIZZczWIX_Cp-UtnI0tOtCJLxgUisUCsTyqA Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: 4b95ce24a4d34e379fa86c9114ece400 Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-703997672 Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:51:27.423558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:51:27.425194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4b95ce24a4d34e379fa86c9114ece400", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4b95ce24a4d34e379fa86c9114ece400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4b95ce24a4d34e379fa86c9114ece400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4b95ce24a4d34e379fa86c9114ece400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:51:27.425194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-AttachVolumeShelveTestJSON-703997672 Aug 04 21:51:27.425194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: 4b95ce24a4d34e379fa86c9114ece400 Aug 04 21:51:27.425194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-703997672 Aug 04 21:51:27.425194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-AttachVolumeShelveTestJSON-703997672-project Aug 04 21:51:27.425194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:51:27.425194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:51:27.425194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: 95fb2edf82644e7f8ce461fcbb52007b Aug 04 21:51:27.425194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-AttachVolumeShelveTestJSON-703997672-project Aug 04 21:51:27.425194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 21:51:27.425194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca could not be found. Aug 04 21:51:27.425194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': '4a6a3daf-6b19-47d0-85ca-eed1eacb91ca'} Aug 04 21:51:27.426082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:51:27.426082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:51:27.426082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:51:27.426082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:51:27.426082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:51:27.426082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:51:27.426082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:51:27.426082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:51:27.426082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:51:27.426082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:51:27.426082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca could not be found. Aug 04 21:51:27.426082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:51:27.426082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:51:27.426082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:51:27.426082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:51:27.426082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:51:27.426082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:51:27.426082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:51:27.426082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:51:27.426082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:51:27.427588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:51:27.427588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:51:27.427588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:51:27.427588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:51:27.427588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:51:27.427588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:51:27.427588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:51:27.427588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca could not be found. Aug 04 21:51:27.427588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:51:27.427588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:51:27.427588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:51:27.427588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:51:27.427588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:51:27.427588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:51:27.427588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:51:27.427588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:51:27.427588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca could not be found. Aug 04 21:51:27.427588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:51:27.428787 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-8e8935f5-708f-40b0-a45a-eb2829b33136 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Returning 404 to user: Instance 4a6a3daf-6b19-47d0-85ca-eed1eacb91ca could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:51:27.428787 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-8e8935f5-708f-40b0-a45a-eb2829b33136 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca" status: 404 len: 111 microversion: 2.20 time: 0.032411 Aug 04 21:51:27.428787 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 464/934] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:51:27 2022] GET /compute/v2.1/servers/4a6a3daf-6b19-47d0-85ca-eed1eacb91ca => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:51:28.687584 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-3d29ce80-3827-4df2-833d-123d119aef7c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:28.688081 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-3d29ce80-3827-4df2-833d-123d119aef7c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:28.694470 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d29ce80-3827-4df2-833d-123d119aef7c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:28.694957 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d29ce80-3827-4df2-833d-123d119aef7c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:28.695396 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d29ce80-3827-4df2-833d-123d119aef7c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:28.696084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d29ce80-3827-4df2-833d-123d119aef7c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:28.696770 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d29ce80-3827-4df2-833d-123d119aef7c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:28.697241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d29ce80-3827-4df2-833d-123d119aef7c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:28.710794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-3d29ce80-3827-4df2-833d-123d119aef7c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] HTTP exception thrown: Instance 87934a42-5a51-4ba4-81ed-d07b785bc090 could not be found. Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-3d29ce80-3827-4df2-833d-123d119aef7c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Request method failure captured: Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: DELETE /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 HTTP/1.1 Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7DzPBxDeOlTeT9BvnBMwEXrSxDm73hCt0hOs_FK-5ilkHyxmcwQj6NdZ5D5SFUhulh-8PvLB1pZ8-Jgg8W7XJw9xdjtn0MTb9pVSZ4Fq28GPc5yXgUKRG3B1oa1JlAo1jvNLkW2SCltjIZZczWIX_Cp-UtnI0tOtCJLxgUisUCsTyqA Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: 4b95ce24a4d34e379fa86c9114ece400 Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-703997672 Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:51:28.712365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:51:28.714267 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4b95ce24a4d34e379fa86c9114ece400", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4b95ce24a4d34e379fa86c9114ece400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4b95ce24a4d34e379fa86c9114ece400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4b95ce24a4d34e379fa86c9114ece400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:51:28.714267 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-AttachVolumeShelveTestJSON-703997672 Aug 04 21:51:28.714267 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: 4b95ce24a4d34e379fa86c9114ece400 Aug 04 21:51:28.714267 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-703997672 Aug 04 21:51:28.714267 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-AttachVolumeShelveTestJSON-703997672-project Aug 04 21:51:28.714267 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:51:28.714267 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:51:28.714267 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: 95fb2edf82644e7f8ce461fcbb52007b Aug 04 21:51:28.714267 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-AttachVolumeShelveTestJSON-703997672-project Aug 04 21:51:28.714267 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:51:28.714267 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance 87934a42-5a51-4ba4-81ed-d07b785bc090 could not be found. Aug 04 21:51:28.714267 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': '87934a42-5a51-4ba4-81ed-d07b785bc090'} Aug 04 21:51:28.715655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:51:28.715655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:51:28.715655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:51:28.715655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:51:28.715655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:51:28.715655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:51:28.715655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:51:28.715655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:51:28.715655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:51:28.715655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:51:28.715655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87934a42-5a51-4ba4-81ed-d07b785bc090 could not be found. Aug 04 21:51:28.715655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:51:28.715655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:51:28.715655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:51:28.715655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:51:28.715655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:51:28.715655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:51:28.715655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:51:28.715655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:51:28.715655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:51:28.717196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:51:28.717196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:51:28.717196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:51:28.717196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:51:28.717196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:51:28.717196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:51:28.717196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:51:28.717196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:51:28.717196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:51:28.717196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87934a42-5a51-4ba4-81ed-d07b785bc090 could not be found. Aug 04 21:51:28.717196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:51:28.717196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:51:28.717196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:51:28.717196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:51:28.717196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:51:28.717196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:51:28.717196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:51:28.717196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:51:28.717196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87934a42-5a51-4ba4-81ed-d07b785bc090 could not be found. Aug 04 21:51:28.717196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:51:28.718764 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-3d29ce80-3827-4df2-833d-123d119aef7c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Returning 404 to user: Instance 87934a42-5a51-4ba4-81ed-d07b785bc090 could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:51:28.718764 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-3d29ce80-3827-4df2-833d-123d119aef7c tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "DELETE /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 404 len: 111 microversion: 2.20 time: 0.030038 Aug 04 21:51:28.718764 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 471/935] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 4 21:51:28 2022] DELETE /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:51:28.724135 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-01712496-6fd0-451e-a92d-b4a059326006 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:28.724744 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-01712496-6fd0-451e-a92d-b4a059326006 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] [instance: 87934a42-5a51-4ba4-81ed-d07b785bc090] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:28.731717 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-01712496-6fd0-451e-a92d-b4a059326006 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:28.732188 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-01712496-6fd0-451e-a92d-b4a059326006 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:28.732616 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-01712496-6fd0-451e-a92d-b4a059326006 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:28.733300 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-01712496-6fd0-451e-a92d-b4a059326006 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:28.733747 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-01712496-6fd0-451e-a92d-b4a059326006 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:28.734189 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-01712496-6fd0-451e-a92d-b4a059326006 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:28.747803 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-01712496-6fd0-451e-a92d-b4a059326006 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] HTTP exception thrown: Instance 87934a42-5a51-4ba4-81ed-d07b785bc090 could not be found. Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-01712496-6fd0-451e-a92d-b4a059326006 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Request method failure captured: Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 HTTP/1.1 Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7DzPBxDeOlTeT9BvnBMwEXrSxDm73hCt0hOs_FK-5ilkHyxmcwQj6NdZ5D5SFUhulh-8PvLB1pZ8-Jgg8W7XJw9xdjtn0MTb9pVSZ4Fq28GPc5yXgUKRG3B1oa1JlAo1jvNLkW2SCltjIZZczWIX_Cp-UtnI0tOtCJLxgUisUCsTyqA Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: 4b95ce24a4d34e379fa86c9114ece400 Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-703997672 Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:51:28.749296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:51:28.750949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4b95ce24a4d34e379fa86c9114ece400", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4b95ce24a4d34e379fa86c9114ece400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4b95ce24a4d34e379fa86c9114ece400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4b95ce24a4d34e379fa86c9114ece400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:51:28.750949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-AttachVolumeShelveTestJSON-703997672 Aug 04 21:51:28.750949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: 4b95ce24a4d34e379fa86c9114ece400 Aug 04 21:51:28.750949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-703997672 Aug 04 21:51:28.750949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-AttachVolumeShelveTestJSON-703997672-project Aug 04 21:51:28.750949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:51:28.750949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:51:28.750949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: 95fb2edf82644e7f8ce461fcbb52007b Aug 04 21:51:28.750949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-AttachVolumeShelveTestJSON-703997672-project Aug 04 21:51:28.750949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 21:51:28.750949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Instance 87934a42-5a51-4ba4-81ed-d07b785bc090 could not be found. Aug 04 21:51:28.750949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': '87934a42-5a51-4ba4-81ed-d07b785bc090'} Aug 04 21:51:28.751975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:51:28.751975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:51:28.751975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:51:28.751975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:51:28.751975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:51:28.751975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:51:28.751975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:51:28.751975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:51:28.751975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:51:28.751975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:51:28.751975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87934a42-5a51-4ba4-81ed-d07b785bc090 could not be found. Aug 04 21:51:28.751975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:51:28.751975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:51:28.751975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:51:28.751975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:51:28.751975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:51:28.751975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:51:28.751975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:51:28.751975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:51:28.751975 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:51:28.753280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:51:28.753280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:51:28.753280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:51:28.753280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:51:28.753280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:51:28.753280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:51:28.753280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:51:28.753280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87934a42-5a51-4ba4-81ed-d07b785bc090 could not be found. Aug 04 21:51:28.753280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:51:28.753280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:51:28.753280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:51:28.753280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:51:28.753280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:51:28.753280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:51:28.753280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:51:28.753280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:51:28.753280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87934a42-5a51-4ba4-81ed-d07b785bc090 could not be found. Aug 04 21:51:28.753280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:51:28.754942 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-01712496-6fd0-451e-a92d-b4a059326006 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] Returning 404 to user: Instance 87934a42-5a51-4ba4-81ed-d07b785bc090 could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:51:28.754942 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-01712496-6fd0-451e-a92d-b4a059326006 tempest-AttachVolumeShelveTestJSON-703997672 tempest-AttachVolumeShelveTestJSON-703997672-project] 10.222.0.73 "GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090" status: 404 len: 111 microversion: 2.20 time: 0.030585 Aug 04 21:51:28.754942 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 465/936] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 4 21:51:28 2022] GET /compute/v2.1/servers/87934a42-5a51-4ba4-81ed-d07b785bc090 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:51:41.626499 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:51:41.627260 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:51:41.770317 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-fbe0d936-edea-4b08-bd97-40ce13293eda tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Action: 'create', calling method: .version_select at 0x7f3c14fa13a0>, body: {"keypair": {"name": "tempest-keypair-1317397069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJyc2bqVwmUX00r1OIvVvSKTyq3OhpXH1rSyimFvEIOoooZ+3rgA7kNGdMttjDYEpDHUD/EI1xK9R4E9OUWlqNfR7X7L+idmEZVsbbIsmupj7jjFtNg6hpBcCCO2msnqg=="}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:51:41.787942 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-fbe0d936-edea-4b08-bd97-40ce13293eda tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Getting quotas for project 8c4ab3c7309249228e42c226277fb14f. Resources: {'key_pairs'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:51:41.791944 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-fbe0d936-edea-4b08-bd97-40ce13293eda tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Getting quotas for user a022ce50f3334e919dcf0008bb6afcf8 and project 8c4ab3c7309249228e42c226277fb14f. Resources: {'key_pairs'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:51:41.912094 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-fbe0d936-edea-4b08-bd97-40ce13293eda tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.292066 Aug 04 21:51:41.912895 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 472/937] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 4 21:51:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:51:44.474969 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-1cccc630-2c56-4e92-9d1f-fac38c901272 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-696065418", "imageRef": "fca0c9ba-fb0a-4f30-932f-84d5253674ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7a01edd-380d-4680-81ec-9f1437601985"}], "security_groups": [{"name": "tempest-securitygroup--1899725043"}], "key_name": "tempest-keypair-1317397069", "user_data": "}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:51:44.484538 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:51:44.485192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=30 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:51:44.587521 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.network.neutron [None req-1cccc630-2c56-4e92-9d1f-fac38c901272 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] validate_networks() for [('f7a01edd-380d-4680-81ec-9f1437601985', None, None, None, None, None)] {{(pid=136341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:51:44.994348 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-1cccc630-2c56-4e92-9d1f-fac38c901272 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Flavor limits 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:51:44.994837 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-1cccc630-2c56-4e92-9d1f-fac38c901272 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Image limits 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:51:44.995429 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-1cccc630-2c56-4e92-9d1f-fac38c901272 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Flavor pref 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:51:44.996069 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-1cccc630-2c56-4e92-9d1f-fac38c901272 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Image pref 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:51:44.997030 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-1cccc630-2c56-4e92-9d1f-fac38c901272 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:51:45.010806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1cccc630-2c56-4e92-9d1f-fac38c901272 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:45.011285 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1cccc630-2c56-4e92-9d1f-fac38c901272 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:45.011753 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1cccc630-2c56-4e92-9d1f-fac38c901272 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:45.013465 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1cccc630-2c56-4e92-9d1f-fac38c901272 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:45.013916 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1cccc630-2c56-4e92-9d1f-fac38c901272 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:45.014522 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1cccc630-2c56-4e92-9d1f-fac38c901272 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:45.031776 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-1cccc630-2c56-4e92-9d1f-fac38c901272 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Getting quotas for project 8c4ab3c7309249228e42c226277fb14f. Resources: {'instances', 'cores', 'ram'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:51:45.035793 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-1cccc630-2c56-4e92-9d1f-fac38c901272 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Getting quotas for user a022ce50f3334e919dcf0008bb6afcf8 and project 8c4ab3c7309249228e42c226277fb14f. Resources: {'instances', 'cores', 'ram'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:51:45.047857 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-1cccc630-2c56-4e92-9d1f-fac38c901272 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Going to run 1 instances... {{(pid=136341) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:51:45.050146 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-1cccc630-2c56-4e92-9d1f-fac38c901272 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca0c9ba-fb0a-4f30-932f-84d5253674ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:51:45.186553 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-1cccc630-2c56-4e92-9d1f-fac38c901272 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.715840 Aug 04 21:51:45.187218 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 466/938] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 4 21:51:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:51:45.198393 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-da1c7956-20d5-441d-9669-d512b442f27f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:45.199140 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-da1c7956-20d5-441d-9669-d512b442f27f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:45.258289 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-da1c7956-20d5-441d-9669-d512b442f27f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:45.266079 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-da1c7956-20d5-441d-9669-d512b442f27f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1241 microversion: 2.1 time: 0.072028 Aug 04 21:51:45.266914 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 473/939] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:51:45 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:46.287592 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b7dba7c2-6946-438e-90fd-575d1144d828 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:46.288311 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b7dba7c2-6946-438e-90fd-575d1144d828 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:46.346979 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b7dba7c2-6946-438e-90fd-575d1144d828 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:46.353648 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b7dba7c2-6946-438e-90fd-575d1144d828 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1241 microversion: 2.1 time: 0.070783 Aug 04 21:51:46.354237 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 467/940] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:51:46 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:47.375136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f02ba1a4-fd94-40f9-997f-ecd5de8a4fba tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:47.375673 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-f02ba1a4-fd94-40f9-997f-ecd5de8a4fba tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:47.382070 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f02ba1a4-fd94-40f9-997f-ecd5de8a4fba tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:47.382570 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f02ba1a4-fd94-40f9-997f-ecd5de8a4fba tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:47.383000 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f02ba1a4-fd94-40f9-997f-ecd5de8a4fba tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:47.383682 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f02ba1a4-fd94-40f9-997f-ecd5de8a4fba tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:47.384126 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f02ba1a4-fd94-40f9-997f-ecd5de8a4fba tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:47.384540 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f02ba1a4-fd94-40f9-997f-ecd5de8a4fba tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:47.446590 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-f02ba1a4-fd94-40f9-997f-ecd5de8a4fba tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:47.454834 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-f02ba1a4-fd94-40f9-997f-ecd5de8a4fba tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1293 microversion: 2.1 time: 0.084420 Aug 04 21:51:47.464423 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 474/941] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:51:47 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:48.476545 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b58d9209-d657-4edb-ac67-d5065617988a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:48.477137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b58d9209-d657-4edb-ac67-d5065617988a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:48.484532 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b58d9209-d657-4edb-ac67-d5065617988a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:48.485018 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b58d9209-d657-4edb-ac67-d5065617988a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:48.485448 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b58d9209-d657-4edb-ac67-d5065617988a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:48.486180 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b58d9209-d657-4edb-ac67-d5065617988a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:48.495974 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b58d9209-d657-4edb-ac67-d5065617988a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:48.495974 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b58d9209-d657-4edb-ac67-d5065617988a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:48.549805 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b58d9209-d657-4edb-ac67-d5065617988a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:48.557458 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b58d9209-d657-4edb-ac67-d5065617988a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1293 microversion: 2.1 time: 0.084947 Aug 04 21:51:48.558045 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 468/942] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:51:48 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:49.579075 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-01c3baf6-9a06-48f8-91f1-2583988f6dcc tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:49.579684 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-01c3baf6-9a06-48f8-91f1-2583988f6dcc tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:49.586068 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-01c3baf6-9a06-48f8-91f1-2583988f6dcc tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:49.586546 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-01c3baf6-9a06-48f8-91f1-2583988f6dcc tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:49.586981 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-01c3baf6-9a06-48f8-91f1-2583988f6dcc tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:49.587670 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-01c3baf6-9a06-48f8-91f1-2583988f6dcc tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:49.588119 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-01c3baf6-9a06-48f8-91f1-2583988f6dcc tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:49.588547 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-01c3baf6-9a06-48f8-91f1-2583988f6dcc tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:49.654051 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-01c3baf6-9a06-48f8-91f1-2583988f6dcc tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:49.662069 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-01c3baf6-9a06-48f8-91f1-2583988f6dcc tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1293 microversion: 2.1 time: 0.087761 Aug 04 21:51:49.662614 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 475/943] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:51:49 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:50.682732 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-17994077-488a-4980-9b1a-b81db4deb488 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:50.683377 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-17994077-488a-4980-9b1a-b81db4deb488 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:50.690519 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-17994077-488a-4980-9b1a-b81db4deb488 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:50.690998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-17994077-488a-4980-9b1a-b81db4deb488 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:50.691429 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-17994077-488a-4980-9b1a-b81db4deb488 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:50.692118 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-17994077-488a-4980-9b1a-b81db4deb488 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:50.692566 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-17994077-488a-4980-9b1a-b81db4deb488 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:50.692993 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-17994077-488a-4980-9b1a-b81db4deb488 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:50.755741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-17994077-488a-4980-9b1a-b81db4deb488 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:50.763265 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-17994077-488a-4980-9b1a-b81db4deb488 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1293 microversion: 2.1 time: 0.084368 Aug 04 21:51:50.763821 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 469/944] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:51:50 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:51.788407 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6f8a61ab-41e6-4854-a15f-eec818e6a651 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:51.789501 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-6f8a61ab-41e6-4854-a15f-eec818e6a651 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:51.796085 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6f8a61ab-41e6-4854-a15f-eec818e6a651 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:51.796649 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6f8a61ab-41e6-4854-a15f-eec818e6a651 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:51.799899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6f8a61ab-41e6-4854-a15f-eec818e6a651 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:51.799899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6f8a61ab-41e6-4854-a15f-eec818e6a651 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:51.799899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6f8a61ab-41e6-4854-a15f-eec818e6a651 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:51.799899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6f8a61ab-41e6-4854-a15f-eec818e6a651 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:51.870268 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6f8a61ab-41e6-4854-a15f-eec818e6a651 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:51.879142 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-6f8a61ab-41e6-4854-a15f-eec818e6a651 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1299 microversion: 2.1 time: 0.094273 Aug 04 21:51:51.879848 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 476/945] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:51:51 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:51.941624 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a9c7cd51-2171-4f1a-bcfc-2c8b0f2a614b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:51:51.941624 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a9c7cd51-2171-4f1a-bcfc-2c8b0f2a614b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:51.948468 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a9c7cd51-2171-4f1a-bcfc-2c8b0f2a614b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:51.948956 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a9c7cd51-2171-4f1a-bcfc-2c8b0f2a614b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:51.949458 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a9c7cd51-2171-4f1a-bcfc-2c8b0f2a614b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:51.950232 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a9c7cd51-2171-4f1a-bcfc-2c8b0f2a614b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:51.950689 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a9c7cd51-2171-4f1a-bcfc-2c8b0f2a614b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:51.951112 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a9c7cd51-2171-4f1a-bcfc-2c8b0f2a614b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:52.143537 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a9c7cd51-2171-4f1a-bcfc-2c8b0f2a614b tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "POST /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28/action" status: 202 len: 0 microversion: 2.1 time: 0.208096 Aug 04 21:51:52.144234 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 470/946] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 4 21:51:51 2022] POST /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:51:52.160073 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e64c6226-23b2-43fd-b506-f9ed4f85cf53 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:52.160684 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e64c6226-23b2-43fd-b506-f9ed4f85cf53 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:52.167278 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e64c6226-23b2-43fd-b506-f9ed4f85cf53 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:52.167660 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e64c6226-23b2-43fd-b506-f9ed4f85cf53 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:52.168099 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e64c6226-23b2-43fd-b506-f9ed4f85cf53 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:52.169590 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e64c6226-23b2-43fd-b506-f9ed4f85cf53 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:52.169590 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e64c6226-23b2-43fd-b506-f9ed4f85cf53 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:52.169808 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e64c6226-23b2-43fd-b506-f9ed4f85cf53 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:52.371833 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e64c6226-23b2-43fd-b506-f9ed4f85cf53 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:52.381779 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e64c6226-23b2-43fd-b506-f9ed4f85cf53 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1752 microversion: 2.1 time: 0.226474 Aug 04 21:51:52.382915 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 477/947] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:51:52 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1752 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:52.911781 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a8dc5443-c8ac-4bbd-b1c7-8a85b7405630 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:52.912821 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a8dc5443-c8ac-4bbd-b1c7-8a85b7405630 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:52.920267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a8dc5443-c8ac-4bbd-b1c7-8a85b7405630 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:52.920758 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a8dc5443-c8ac-4bbd-b1c7-8a85b7405630 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:52.921418 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a8dc5443-c8ac-4bbd-b1c7-8a85b7405630 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:52.922156 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a8dc5443-c8ac-4bbd-b1c7-8a85b7405630 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:52.922610 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a8dc5443-c8ac-4bbd-b1c7-8a85b7405630 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:52.923031 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a8dc5443-c8ac-4bbd-b1c7-8a85b7405630 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:53.082879 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a8dc5443-c8ac-4bbd-b1c7-8a85b7405630 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:53.095379 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a8dc5443-c8ac-4bbd-b1c7-8a85b7405630 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1367 microversion: 2.1 time: 0.185646 Aug 04 21:51:53.095379 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 471/948] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:51:52 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:53.217912 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-d4b62f4f-5101-403b-935b-862e6094b7b9 req-525f6fb4-0d66-43de-8a6c-59d1bbd6dd67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f9071d4-b230-4be2-aadd-ef84b2cd0e39", "tag": "8f85582c-e289-4635-88d7-589adab599e9"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:51:53.227582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-d4b62f4f-5101-403b-935b-862e6094b7b9 req-525f6fb4-0d66-43de-8a6c-59d1bbd6dd67 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:53.228074 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-d4b62f4f-5101-403b-935b-862e6094b7b9 req-525f6fb4-0d66-43de-8a6c-59d1bbd6dd67 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:53.228501 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-d4b62f4f-5101-403b-935b-862e6094b7b9 req-525f6fb4-0d66-43de-8a6c-59d1bbd6dd67 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:53.240356 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-d4b62f4f-5101-403b-935b-862e6094b7b9 req-525f6fb4-0d66-43de-8a6c-59d1bbd6dd67 service nova] Creating event network-changed:8f85582c-e289-4635-88d7-589adab599e9 for instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 on hv-cinder-85220 Aug 04 21:51:53.246441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-d4b62f4f-5101-403b-935b-862e6094b7b9 req-525f6fb4-0d66-43de-8a6c-59d1bbd6dd67 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109926 Aug 04 21:51:53.247046 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 478/949] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:51:53.404212 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d86828de-5f0d-473f-a66e-634443a7abc6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:53.405082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-d86828de-5f0d-473f-a66e-634443a7abc6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:53.414709 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d86828de-5f0d-473f-a66e-634443a7abc6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:53.415384 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d86828de-5f0d-473f-a66e-634443a7abc6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:53.415888 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d86828de-5f0d-473f-a66e-634443a7abc6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:53.416868 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d86828de-5f0d-473f-a66e-634443a7abc6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:53.417801 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d86828de-5f0d-473f-a66e-634443a7abc6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:53.418402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d86828de-5f0d-473f-a66e-634443a7abc6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:53.597521 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d86828de-5f0d-473f-a66e-634443a7abc6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:53.605979 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d86828de-5f0d-473f-a66e-634443a7abc6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1757 microversion: 2.1 time: 0.205866 Aug 04 21:51:53.606805 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 472/950] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:51:53 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1757 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:54.123132 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-fcdf94a5-14e4-4964-bb62-8df031060b81 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:54.123762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-fcdf94a5-14e4-4964-bb62-8df031060b81 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:54.130096 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fcdf94a5-14e4-4964-bb62-8df031060b81 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:54.130575 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fcdf94a5-14e4-4964-bb62-8df031060b81 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:54.131002 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fcdf94a5-14e4-4964-bb62-8df031060b81 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:54.131676 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fcdf94a5-14e4-4964-bb62-8df031060b81 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:54.132122 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fcdf94a5-14e4-4964-bb62-8df031060b81 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:54.132535 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fcdf94a5-14e4-4964-bb62-8df031060b81 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:54.269947 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-fcdf94a5-14e4-4964-bb62-8df031060b81 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:54.277402 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-fcdf94a5-14e4-4964-bb62-8df031060b81 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1367 microversion: 2.1 time: 0.158754 Aug 04 21:51:54.277962 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 479/951] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:51:54 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:54.627908 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-70d93fa5-85dd-41e7-8f98-9dd53833a8f8 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:54.628509 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-70d93fa5-85dd-41e7-8f98-9dd53833a8f8 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:54.634931 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-70d93fa5-85dd-41e7-8f98-9dd53833a8f8 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:54.635404 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-70d93fa5-85dd-41e7-8f98-9dd53833a8f8 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:54.635836 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-70d93fa5-85dd-41e7-8f98-9dd53833a8f8 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:54.636510 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-70d93fa5-85dd-41e7-8f98-9dd53833a8f8 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:54.636948 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-70d93fa5-85dd-41e7-8f98-9dd53833a8f8 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:54.637362 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-70d93fa5-85dd-41e7-8f98-9dd53833a8f8 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:54.780244 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-70d93fa5-85dd-41e7-8f98-9dd53833a8f8 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:54.788127 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-70d93fa5-85dd-41e7-8f98-9dd53833a8f8 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1757 microversion: 2.1 time: 0.164683 Aug 04 21:51:54.788686 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 473/952] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:51:54 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:55.299460 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-556998af-de03-44e8-9a77-cbe4f5976feb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:55.300017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-556998af-de03-44e8-9a77-cbe4f5976feb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:55.302484 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=6 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:51:55.307433 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-556998af-de03-44e8-9a77-cbe4f5976feb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:55.307916 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-556998af-de03-44e8-9a77-cbe4f5976feb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:55.316151 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-556998af-de03-44e8-9a77-cbe4f5976feb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:55.316151 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-556998af-de03-44e8-9a77-cbe4f5976feb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:55.316151 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-556998af-de03-44e8-9a77-cbe4f5976feb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:55.316151 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-556998af-de03-44e8-9a77-cbe4f5976feb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:55.443745 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-556998af-de03-44e8-9a77-cbe4f5976feb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:55.451345 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-556998af-de03-44e8-9a77-cbe4f5976feb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1367 microversion: 2.1 time: 0.156049 Aug 04 21:51:55.451905 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 480/953] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:51:55 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:55.809434 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-532e27b7-04de-4727-9ec6-8f66c78711eb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:55.810129 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-532e27b7-04de-4727-9ec6-8f66c78711eb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:55.812848 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=2 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:51:55.818291 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-532e27b7-04de-4727-9ec6-8f66c78711eb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:55.821476 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-532e27b7-04de-4727-9ec6-8f66c78711eb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:55.821476 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-532e27b7-04de-4727-9ec6-8f66c78711eb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:55.821476 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-532e27b7-04de-4727-9ec6-8f66c78711eb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:55.821476 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-532e27b7-04de-4727-9ec6-8f66c78711eb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:55.821857 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-532e27b7-04de-4727-9ec6-8f66c78711eb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:55.971158 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-532e27b7-04de-4727-9ec6-8f66c78711eb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:55.979124 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-532e27b7-04de-4727-9ec6-8f66c78711eb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1757 microversion: 2.1 time: 0.173624 Aug 04 21:51:55.979680 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 474/954] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:51:55 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:56.472886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-cc2567b2-fedb-4f15-8c38-c829bdead643 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:56.473449 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-cc2567b2-fedb-4f15-8c38-c829bdead643 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:56.480035 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cc2567b2-fedb-4f15-8c38-c829bdead643 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:56.480518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cc2567b2-fedb-4f15-8c38-c829bdead643 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:56.480945 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cc2567b2-fedb-4f15-8c38-c829bdead643 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:56.481626 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cc2567b2-fedb-4f15-8c38-c829bdead643 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:56.482105 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cc2567b2-fedb-4f15-8c38-c829bdead643 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:56.482523 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cc2567b2-fedb-4f15-8c38-c829bdead643 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:56.614323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-cc2567b2-fedb-4f15-8c38-c829bdead643 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:56.622262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-cc2567b2-fedb-4f15-8c38-c829bdead643 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1367 microversion: 2.1 time: 0.153308 Aug 04 21:51:56.623072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 481/955] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:51:56 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:57.000968 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-54a55191-4c15-4102-9837-cee6a54e3405 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:57.001578 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-54a55191-4c15-4102-9837-cee6a54e3405 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:57.003430 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=8 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:51:57.008786 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-54a55191-4c15-4102-9837-cee6a54e3405 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:57.009268 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-54a55191-4c15-4102-9837-cee6a54e3405 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:57.009706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-54a55191-4c15-4102-9837-cee6a54e3405 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:57.010466 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-54a55191-4c15-4102-9837-cee6a54e3405 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:57.010986 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-54a55191-4c15-4102-9837-cee6a54e3405 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:57.011415 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-54a55191-4c15-4102-9837-cee6a54e3405 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:57.157318 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-54a55191-4c15-4102-9837-cee6a54e3405 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:57.165431 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-54a55191-4c15-4102-9837-cee6a54e3405 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1757 microversion: 2.1 time: 0.169205 Aug 04 21:51:57.165990 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 475/956] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:51:56 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:57.644491 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8dcaecc1-767c-4202-acf8-c43ac826f3b6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:57.645060 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8dcaecc1-767c-4202-acf8-c43ac826f3b6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:57.651418 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8dcaecc1-767c-4202-acf8-c43ac826f3b6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:57.651892 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8dcaecc1-767c-4202-acf8-c43ac826f3b6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:57.652319 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8dcaecc1-767c-4202-acf8-c43ac826f3b6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:57.652996 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8dcaecc1-767c-4202-acf8-c43ac826f3b6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:57.653439 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8dcaecc1-767c-4202-acf8-c43ac826f3b6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:57.653852 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8dcaecc1-767c-4202-acf8-c43ac826f3b6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:57.785729 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8dcaecc1-767c-4202-acf8-c43ac826f3b6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:57.793174 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8dcaecc1-767c-4202-acf8-c43ac826f3b6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1367 microversion: 2.1 time: 0.153249 Aug 04 21:51:57.793748 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 482/957] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:51:57 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:58.187535 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-3721cbc6-37b4-48aa-a170-c34493bce821 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:58.189567 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-3721cbc6-37b4-48aa-a170-c34493bce821 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:58.194549 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3721cbc6-37b4-48aa-a170-c34493bce821 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:58.195030 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3721cbc6-37b4-48aa-a170-c34493bce821 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:58.195462 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3721cbc6-37b4-48aa-a170-c34493bce821 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:58.196147 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3721cbc6-37b4-48aa-a170-c34493bce821 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:58.196594 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3721cbc6-37b4-48aa-a170-c34493bce821 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:58.197014 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3721cbc6-37b4-48aa-a170-c34493bce821 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:58.347678 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-3721cbc6-37b4-48aa-a170-c34493bce821 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:58.355854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-3721cbc6-37b4-48aa-a170-c34493bce821 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1757 microversion: 2.1 time: 0.172373 Aug 04 21:51:58.356425 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 476/958] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:51:58 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:58.814115 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b737cfcb-3654-466b-a20d-483db4ca9246 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:58.814716 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b737cfcb-3654-466b-a20d-483db4ca9246 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:58.821220 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b737cfcb-3654-466b-a20d-483db4ca9246 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:58.821702 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b737cfcb-3654-466b-a20d-483db4ca9246 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:58.822159 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b737cfcb-3654-466b-a20d-483db4ca9246 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:58.822845 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b737cfcb-3654-466b-a20d-483db4ca9246 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:58.823291 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b737cfcb-3654-466b-a20d-483db4ca9246 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:58.823706 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b737cfcb-3654-466b-a20d-483db4ca9246 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:58.960619 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b737cfcb-3654-466b-a20d-483db4ca9246 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:58.969296 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b737cfcb-3654-466b-a20d-483db4ca9246 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1367 microversion: 2.1 time: 0.158941 Aug 04 21:51:58.970042 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 483/959] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:51:58 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:59.377268 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-4427ac52-2709-4421-8602-dcd15a87d8af tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:59.377807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-4427ac52-2709-4421-8602-dcd15a87d8af tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:59.384067 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4427ac52-2709-4421-8602-dcd15a87d8af tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:59.384545 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4427ac52-2709-4421-8602-dcd15a87d8af tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:59.384974 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4427ac52-2709-4421-8602-dcd15a87d8af tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:59.385659 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4427ac52-2709-4421-8602-dcd15a87d8af tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:59.386136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4427ac52-2709-4421-8602-dcd15a87d8af tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:59.386558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4427ac52-2709-4421-8602-dcd15a87d8af tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:51:59.532599 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4427ac52-2709-4421-8602-dcd15a87d8af tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:51:59.540686 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-4427ac52-2709-4421-8602-dcd15a87d8af tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1757 microversion: 2.1 time: 0.167821 Aug 04 21:51:59.541248 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 477/960] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:51:59 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:51:59.990142 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-414e3615-7e07-4141-8b80-af4712f4fcad tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:51:59.990761 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-414e3615-7e07-4141-8b80-af4712f4fcad tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:51:59.997431 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-414e3615-7e07-4141-8b80-af4712f4fcad tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:51:59.998213 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-414e3615-7e07-4141-8b80-af4712f4fcad tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:51:59.998679 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-414e3615-7e07-4141-8b80-af4712f4fcad tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:00.000069 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-414e3615-7e07-4141-8b80-af4712f4fcad tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:00.000552 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-414e3615-7e07-4141-8b80-af4712f4fcad tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:00.000975 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-414e3615-7e07-4141-8b80-af4712f4fcad tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:00.236962 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-414e3615-7e07-4141-8b80-af4712f4fcad tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:00.246058 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-414e3615-7e07-4141-8b80-af4712f4fcad tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1367 microversion: 2.1 time: 0.259704 Aug 04 21:52:00.247101 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 484/961] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:51:59 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:00.562705 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-df60eaab-12cf-4d5b-91c6-a8d37b0f53e0 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:00.563309 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-df60eaab-12cf-4d5b-91c6-a8d37b0f53e0 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:00.570259 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-df60eaab-12cf-4d5b-91c6-a8d37b0f53e0 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:00.570752 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-df60eaab-12cf-4d5b-91c6-a8d37b0f53e0 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:00.571184 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-df60eaab-12cf-4d5b-91c6-a8d37b0f53e0 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:00.571895 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-df60eaab-12cf-4d5b-91c6-a8d37b0f53e0 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:00.572337 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-df60eaab-12cf-4d5b-91c6-a8d37b0f53e0 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:00.572752 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-df60eaab-12cf-4d5b-91c6-a8d37b0f53e0 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:00.727769 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-df60eaab-12cf-4d5b-91c6-a8d37b0f53e0 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:00.736832 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-df60eaab-12cf-4d5b-91c6-a8d37b0f53e0 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1757 microversion: 2.1 time: 0.178740 Aug 04 21:52:00.737422 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 478/962] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:00 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:01.267286 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-966319b0-9f51-4b18-bb6b-57a95022eb97 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:01.268018 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-966319b0-9f51-4b18-bb6b-57a95022eb97 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:01.274813 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-966319b0-9f51-4b18-bb6b-57a95022eb97 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:01.275299 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-966319b0-9f51-4b18-bb6b-57a95022eb97 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:01.275736 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-966319b0-9f51-4b18-bb6b-57a95022eb97 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:01.276432 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-966319b0-9f51-4b18-bb6b-57a95022eb97 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:01.276889 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-966319b0-9f51-4b18-bb6b-57a95022eb97 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:01.277313 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-966319b0-9f51-4b18-bb6b-57a95022eb97 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:01.407366 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-966319b0-9f51-4b18-bb6b-57a95022eb97 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:01.414749 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-966319b0-9f51-4b18-bb6b-57a95022eb97 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1367 microversion: 2.1 time: 0.152156 Aug 04 21:52:01.415308 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 485/963] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:01 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:01.758680 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-75d8d618-471a-4f20-b25f-186dfc1e9c93 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:01.759326 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-75d8d618-471a-4f20-b25f-186dfc1e9c93 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:01.765858 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-75d8d618-471a-4f20-b25f-186dfc1e9c93 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:01.766366 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-75d8d618-471a-4f20-b25f-186dfc1e9c93 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:01.766797 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-75d8d618-471a-4f20-b25f-186dfc1e9c93 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:01.767486 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-75d8d618-471a-4f20-b25f-186dfc1e9c93 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:01.767930 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-75d8d618-471a-4f20-b25f-186dfc1e9c93 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:01.768373 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-75d8d618-471a-4f20-b25f-186dfc1e9c93 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:01.917025 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-75d8d618-471a-4f20-b25f-186dfc1e9c93 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:01.925724 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-75d8d618-471a-4f20-b25f-186dfc1e9c93 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1757 microversion: 2.1 time: 0.170935 Aug 04 21:52:01.926392 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 479/964] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:01 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:02.435850 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2e8f72e9-2d18-4575-a2dc-1f90b35a404f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:02.436464 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2e8f72e9-2d18-4575-a2dc-1f90b35a404f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:02.443166 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2e8f72e9-2d18-4575-a2dc-1f90b35a404f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:02.443653 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2e8f72e9-2d18-4575-a2dc-1f90b35a404f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:02.444082 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2e8f72e9-2d18-4575-a2dc-1f90b35a404f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:02.444767 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2e8f72e9-2d18-4575-a2dc-1f90b35a404f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:02.445245 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2e8f72e9-2d18-4575-a2dc-1f90b35a404f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:02.445665 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2e8f72e9-2d18-4575-a2dc-1f90b35a404f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:02.575109 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2e8f72e9-2d18-4575-a2dc-1f90b35a404f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:02.583107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2e8f72e9-2d18-4575-a2dc-1f90b35a404f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1367 microversion: 2.1 time: 0.151170 Aug 04 21:52:02.583661 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 486/965] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:02 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:02.949661 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-193ce2ac-c346-4a01-b6e2-f0a81c8838cd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:02.950303 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-193ce2ac-c346-4a01-b6e2-f0a81c8838cd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:02.957734 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-193ce2ac-c346-4a01-b6e2-f0a81c8838cd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:02.958529 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-193ce2ac-c346-4a01-b6e2-f0a81c8838cd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:02.959071 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-193ce2ac-c346-4a01-b6e2-f0a81c8838cd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:02.961539 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-193ce2ac-c346-4a01-b6e2-f0a81c8838cd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:02.962000 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-193ce2ac-c346-4a01-b6e2-f0a81c8838cd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:02.962464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-193ce2ac-c346-4a01-b6e2-f0a81c8838cd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:03.126768 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-193ce2ac-c346-4a01-b6e2-f0a81c8838cd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:03.135137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-193ce2ac-c346-4a01-b6e2-f0a81c8838cd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1757 microversion: 2.1 time: 0.191119 Aug 04 21:52:03.135707 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 480/966] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:02 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:03.355996 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-4ddeec56-f1d2-444a-ba12-33bddf25d8a4 req-f80da4b7-5db9-4036-bf94-005753b47a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f9071d4-b230-4be2-aadd-ef84b2cd0e39", "name": "network-vif-plugged", "status": "completed", "tag": "8f85582c-e289-4635-88d7-589adab599e9"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:52:03.366087 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-4ddeec56-f1d2-444a-ba12-33bddf25d8a4 req-f80da4b7-5db9-4036-bf94-005753b47a72 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:03.366595 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-4ddeec56-f1d2-444a-ba12-33bddf25d8a4 req-f80da4b7-5db9-4036-bf94-005753b47a72 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:03.367020 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-4ddeec56-f1d2-444a-ba12-33bddf25d8a4 req-f80da4b7-5db9-4036-bf94-005753b47a72 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:03.378771 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-4ddeec56-f1d2-444a-ba12-33bddf25d8a4 req-f80da4b7-5db9-4036-bf94-005753b47a72 service nova] Creating event network-vif-plugged:8f85582c-e289-4635-88d7-589adab599e9 for instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 on hv-cinder-85220 Aug 04 21:52:03.383884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-4ddeec56-f1d2-444a-ba12-33bddf25d8a4 req-f80da4b7-5db9-4036-bf94-005753b47a72 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031831 Aug 04 21:52:03.384538 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 487/967] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:52:03.603514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a90b4692-8ae4-4301-ba94-5de891eaee71 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:03.604037 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a90b4692-8ae4-4301-ba94-5de891eaee71 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:03.610173 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a90b4692-8ae4-4301-ba94-5de891eaee71 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:03.610728 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a90b4692-8ae4-4301-ba94-5de891eaee71 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:03.611152 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a90b4692-8ae4-4301-ba94-5de891eaee71 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:03.611841 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a90b4692-8ae4-4301-ba94-5de891eaee71 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:03.612314 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a90b4692-8ae4-4301-ba94-5de891eaee71 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:03.612707 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a90b4692-8ae4-4301-ba94-5de891eaee71 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:03.750557 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a90b4692-8ae4-4301-ba94-5de891eaee71 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:03.758403 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a90b4692-8ae4-4301-ba94-5de891eaee71 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1367 microversion: 2.1 time: 0.158760 Aug 04 21:52:03.758980 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 481/968] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:03 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:04.159088 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a6ee71dd-e39c-400a-97c8-0d9374a8bce4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:04.160438 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-a6ee71dd-e39c-400a-97c8-0d9374a8bce4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:04.166663 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a6ee71dd-e39c-400a-97c8-0d9374a8bce4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:04.167135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a6ee71dd-e39c-400a-97c8-0d9374a8bce4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:04.167558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a6ee71dd-e39c-400a-97c8-0d9374a8bce4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:04.168237 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a6ee71dd-e39c-400a-97c8-0d9374a8bce4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:04.168683 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a6ee71dd-e39c-400a-97c8-0d9374a8bce4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:04.169098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a6ee71dd-e39c-400a-97c8-0d9374a8bce4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:04.317939 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-a6ee71dd-e39c-400a-97c8-0d9374a8bce4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:04.326248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-a6ee71dd-e39c-400a-97c8-0d9374a8bce4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1757 microversion: 2.1 time: 0.173283 Aug 04 21:52:04.326814 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 488/969] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:04 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:04.779499 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d2d87db4-0664-4286-8d0d-b4bb7028d51d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:04.780220 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-d2d87db4-0664-4286-8d0d-b4bb7028d51d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:04.788012 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d2d87db4-0664-4286-8d0d-b4bb7028d51d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:04.789875 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d2d87db4-0664-4286-8d0d-b4bb7028d51d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:04.789875 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d2d87db4-0664-4286-8d0d-b4bb7028d51d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:04.789875 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d2d87db4-0664-4286-8d0d-b4bb7028d51d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:04.790229 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d2d87db4-0664-4286-8d0d-b4bb7028d51d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:04.790439 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d2d87db4-0664-4286-8d0d-b4bb7028d51d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:04.932989 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d2d87db4-0664-4286-8d0d-b4bb7028d51d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:04.940565 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d2d87db4-0664-4286-8d0d-b4bb7028d51d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1367 microversion: 2.1 time: 0.164900 Aug 04 21:52:04.941069 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 482/970] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:04 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:05.350721 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d09574c8-7486-4e78-870d-6261c2ececb5 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:05.351326 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d09574c8-7486-4e78-870d-6261c2ececb5 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:05.359019 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d09574c8-7486-4e78-870d-6261c2ececb5 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:05.359019 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d09574c8-7486-4e78-870d-6261c2ececb5 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:05.359019 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d09574c8-7486-4e78-870d-6261c2ececb5 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:05.361728 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d09574c8-7486-4e78-870d-6261c2ececb5 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:05.362250 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d09574c8-7486-4e78-870d-6261c2ececb5 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:05.362689 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d09574c8-7486-4e78-870d-6261c2ececb5 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:05.506744 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d09574c8-7486-4e78-870d-6261c2ececb5 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:05.515133 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d09574c8-7486-4e78-870d-6261c2ececb5 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1757 microversion: 2.1 time: 0.168256 Aug 04 21:52:05.515702 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 489/971] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:05 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:05.961137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-5b102418-b871-41cd-b0b0-70f9ae32c725 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:05.961660 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-5b102418-b871-41cd-b0b0-70f9ae32c725 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:05.968359 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5b102418-b871-41cd-b0b0-70f9ae32c725 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:05.968841 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5b102418-b871-41cd-b0b0-70f9ae32c725 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:05.969423 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5b102418-b871-41cd-b0b0-70f9ae32c725 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:05.970383 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5b102418-b871-41cd-b0b0-70f9ae32c725 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:05.970837 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5b102418-b871-41cd-b0b0-70f9ae32c725 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:05.971259 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5b102418-b871-41cd-b0b0-70f9ae32c725 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:05.975265 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:52:06.122179 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5b102418-b871-41cd-b0b0-70f9ae32c725 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:06.130722 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-5b102418-b871-41cd-b0b0-70f9ae32c725 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1367 microversion: 2.1 time: 0.173516 Aug 04 21:52:06.131289 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 483/972] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:05 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:06.537471 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-3eea1c9b-4f13-4144-bb5c-aaa9a8049527 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:06.538256 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-3eea1c9b-4f13-4144-bb5c-aaa9a8049527 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:06.545059 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3eea1c9b-4f13-4144-bb5c-aaa9a8049527 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:06.545545 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3eea1c9b-4f13-4144-bb5c-aaa9a8049527 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:06.545983 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3eea1c9b-4f13-4144-bb5c-aaa9a8049527 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:06.546698 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3eea1c9b-4f13-4144-bb5c-aaa9a8049527 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:06.547950 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3eea1c9b-4f13-4144-bb5c-aaa9a8049527 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:06.548261 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3eea1c9b-4f13-4144-bb5c-aaa9a8049527 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:06.704133 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-3eea1c9b-4f13-4144-bb5c-aaa9a8049527 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:06.712256 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-3eea1c9b-4f13-4144-bb5c-aaa9a8049527 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1757 microversion: 2.1 time: 0.178757 Aug 04 21:52:06.713031 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 490/973] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:06 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:52:07.153169 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-67d6ce2b-9498-4e53-8fa3-f55f6d45ee99 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:07.153775 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-67d6ce2b-9498-4e53-8fa3-f55f6d45ee99 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:07.161384 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-67d6ce2b-9498-4e53-8fa3-f55f6d45ee99 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:07.161871 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-67d6ce2b-9498-4e53-8fa3-f55f6d45ee99 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:07.162335 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-67d6ce2b-9498-4e53-8fa3-f55f6d45ee99 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:07.163023 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-67d6ce2b-9498-4e53-8fa3-f55f6d45ee99 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:07.163466 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-67d6ce2b-9498-4e53-8fa3-f55f6d45ee99 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:07.163873 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-67d6ce2b-9498-4e53-8fa3-f55f6d45ee99 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:07.301793 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-67d6ce2b-9498-4e53-8fa3-f55f6d45ee99 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:07.309218 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-67d6ce2b-9498-4e53-8fa3-f55f6d45ee99 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1557 microversion: 2.1 time: 0.160379 Aug 04 21:52:07.309781 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 484/974] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:07 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:07.332545 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-5c83090a-177a-40cc-b6e2-50ed40b66545 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:07.333115 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-5c83090a-177a-40cc-b6e2-50ed40b66545 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:07.339460 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5c83090a-177a-40cc-b6e2-50ed40b66545 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:07.339953 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5c83090a-177a-40cc-b6e2-50ed40b66545 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:07.340385 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5c83090a-177a-40cc-b6e2-50ed40b66545 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:07.341108 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5c83090a-177a-40cc-b6e2-50ed40b66545 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:07.341838 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5c83090a-177a-40cc-b6e2-50ed40b66545 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:07.342231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-5c83090a-177a-40cc-b6e2-50ed40b66545 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:07.423323 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-5c83090a-177a-40cc-b6e2-50ed40b66545 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096667 Aug 04 21:52:07.423950 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 491/975] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 4 21:52:07 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:52:07.735388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-41e26de6-adcc-4d8b-b3ca-019b72a9b2ee tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:07.736041 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-41e26de6-adcc-4d8b-b3ca-019b72a9b2ee tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:07.754443 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-41e26de6-adcc-4d8b-b3ca-019b72a9b2ee tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:07.755207 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-41e26de6-adcc-4d8b-b3ca-019b72a9b2ee tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:07.755812 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-41e26de6-adcc-4d8b-b3ca-019b72a9b2ee tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:07.756522 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-41e26de6-adcc-4d8b-b3ca-019b72a9b2ee tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:07.756972 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-41e26de6-adcc-4d8b-b3ca-019b72a9b2ee tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:07.757394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-41e26de6-adcc-4d8b-b3ca-019b72a9b2ee tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:07.977525 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-41e26de6-adcc-4d8b-b3ca-019b72a9b2ee tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:07.985836 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-41e26de6-adcc-4d8b-b3ca-019b72a9b2ee tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1757 microversion: 2.1 time: 0.254912 Aug 04 21:52:07.986848 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 485/976] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:07 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1757 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:08.594555 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-aa52d760-f822-4aba-9621-1d0c08b7b77b req-fe184721-51d6-4f74-a1f9-53ab6d2d9e45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f9071d4-b230-4be2-aadd-ef84b2cd0e39", "tag": "8f85582c-e289-4635-88d7-589adab599e9"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:52:08.604516 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-aa52d760-f822-4aba-9621-1d0c08b7b77b req-fe184721-51d6-4f74-a1f9-53ab6d2d9e45 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:08.605519 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-aa52d760-f822-4aba-9621-1d0c08b7b77b req-fe184721-51d6-4f74-a1f9-53ab6d2d9e45 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:08.606391 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-aa52d760-f822-4aba-9621-1d0c08b7b77b req-fe184721-51d6-4f74-a1f9-53ab6d2d9e45 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:08.610855 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=100 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:52:08.618848 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-aa52d760-f822-4aba-9621-1d0c08b7b77b req-fe184721-51d6-4f74-a1f9-53ab6d2d9e45 service nova] Creating event network-changed:8f85582c-e289-4635-88d7-589adab599e9 for instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 on hv-cinder-85220 Aug 04 21:52:08.626878 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-aa52d760-f822-4aba-9621-1d0c08b7b77b req-fe184721-51d6-4f74-a1f9-53ab6d2d9e45 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036758 Aug 04 21:52:08.627671 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 492/977] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:52:09.008622 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-bbf64780-7a24-4e51-9d24-610773c1b5fe tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:09.010091 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-bbf64780-7a24-4e51-9d24-610773c1b5fe tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:09.021378 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bbf64780-7a24-4e51-9d24-610773c1b5fe tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:09.022511 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bbf64780-7a24-4e51-9d24-610773c1b5fe tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:09.023420 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bbf64780-7a24-4e51-9d24-610773c1b5fe tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:09.024900 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bbf64780-7a24-4e51-9d24-610773c1b5fe tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:09.025380 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bbf64780-7a24-4e51-9d24-610773c1b5fe tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:09.029351 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bbf64780-7a24-4e51-9d24-610773c1b5fe tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:09.517605 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-bbf64780-7a24-4e51-9d24-610773c1b5fe tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:09.528757 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-bbf64780-7a24-4e51-9d24-610773c1b5fe tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1757 microversion: 2.1 time: 0.524709 Aug 04 21:52:09.529856 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 486/978] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:09 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1757 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:10.554219 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2513b865-36c2-491f-a1ab-054bc8e2fc93 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:10.554939 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2513b865-36c2-491f-a1ab-054bc8e2fc93 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:10.563807 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2513b865-36c2-491f-a1ab-054bc8e2fc93 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:10.563807 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2513b865-36c2-491f-a1ab-054bc8e2fc93 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:10.563807 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2513b865-36c2-491f-a1ab-054bc8e2fc93 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:10.563807 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2513b865-36c2-491f-a1ab-054bc8e2fc93 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:10.564291 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2513b865-36c2-491f-a1ab-054bc8e2fc93 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:10.564291 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2513b865-36c2-491f-a1ab-054bc8e2fc93 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:10.742328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2513b865-36c2-491f-a1ab-054bc8e2fc93 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:10.751298 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2513b865-36c2-491f-a1ab-054bc8e2fc93 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1757 microversion: 2.1 time: 0.202552 Aug 04 21:52:10.752073 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 493/979] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:10 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1757 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:52:11.771963 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a2aaf1a8-95b9-4957-9c64-e66b86d0f113 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:11.773309 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a2aaf1a8-95b9-4957-9c64-e66b86d0f113 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:11.783740 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a2aaf1a8-95b9-4957-9c64-e66b86d0f113 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:11.784238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a2aaf1a8-95b9-4957-9c64-e66b86d0f113 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:11.784674 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a2aaf1a8-95b9-4957-9c64-e66b86d0f113 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:11.785373 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a2aaf1a8-95b9-4957-9c64-e66b86d0f113 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:11.785820 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a2aaf1a8-95b9-4957-9c64-e66b86d0f113 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:11.786322 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a2aaf1a8-95b9-4957-9c64-e66b86d0f113 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:12.050410 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a2aaf1a8-95b9-4957-9c64-e66b86d0f113 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:12.059242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a2aaf1a8-95b9-4957-9c64-e66b86d0f113 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1760 microversion: 2.1 time: 0.291094 Aug 04 21:52:12.060133 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 487/980] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:11 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1760 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:18.911901 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-905ec381-be32-4628-915d-f937908f6b9c tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Action: 'create', calling method: .version_select at 0x7f3c10684e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-460637521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNaPdPE7PfyKVt8yBYbVsdbmi4jDh0fjKPKl6fuhk/xl11ucWrO880Kql3jQHkp8Aa6XnBfKSPRCufPcP/9QY+QFk0DX5adu/3v2oN+5IreyoOek5znz6+xxZ96QxXx3A=="}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:52:18.917846 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:52:18.929564 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-905ec381-be32-4628-915d-f937908f6b9c tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Getting quotas for project bd7cf7a2010f419688871e4c9469084d. Resources: {'key_pairs'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:52:18.933998 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-905ec381-be32-4628-915d-f937908f6b9c tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Getting quotas for user 38358c71d0eb4d63a008925b18e68adb and project bd7cf7a2010f419688871e4c9469084d. Resources: {'key_pairs'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:52:19.049052 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-905ec381-be32-4628-915d-f937908f6b9c tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.315955 Aug 04 21:52:19.049856 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 494/981] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 4 21:52:18 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:52:44.730232 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-1f84f7f4-0fa0-48eb-83a7-ffcfaf4d9cf5 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1451665947", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-460637521", "security_groups": [{"name": "tempest-secgroup-smoke-1566814698"}], "networks": [{"uuid": "83c1f1d4-da8e-4bdf-a16d-5d555059f8f1"}], "block_device_mapping_v2": [{"uuid": "454323ea-a7c2-4fcf-b4a1-24de648ea204", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:52:44.741546 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:52:44.744096 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=28 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:52:44.854426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.network.neutron [None req-1f84f7f4-0fa0-48eb-83a7-ffcfaf4d9cf5 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] validate_networks() for [('83c1f1d4-da8e-4bdf-a16d-5d555059f8f1', None, None, None, None, None)] {{(pid=136341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:52:45.233216 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-1f84f7f4-0fa0-48eb-83a7-ffcfaf4d9cf5 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Flavor limits 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:52:45.233635 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-1f84f7f4-0fa0-48eb-83a7-ffcfaf4d9cf5 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Image limits 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:52:45.234160 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-1f84f7f4-0fa0-48eb-83a7-ffcfaf4d9cf5 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Flavor pref 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:52:45.234575 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-1f84f7f4-0fa0-48eb-83a7-ffcfaf4d9cf5 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Image pref 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:52:45.234992 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-1f84f7f4-0fa0-48eb-83a7-ffcfaf4d9cf5 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:52:45.243919 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1f84f7f4-0fa0-48eb-83a7-ffcfaf4d9cf5 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:45.244398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1f84f7f4-0fa0-48eb-83a7-ffcfaf4d9cf5 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:45.244828 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1f84f7f4-0fa0-48eb-83a7-ffcfaf4d9cf5 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:45.245558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1f84f7f4-0fa0-48eb-83a7-ffcfaf4d9cf5 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:45.246554 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1f84f7f4-0fa0-48eb-83a7-ffcfaf4d9cf5 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:45.246972 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1f84f7f4-0fa0-48eb-83a7-ffcfaf4d9cf5 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:45.265276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-1f84f7f4-0fa0-48eb-83a7-ffcfaf4d9cf5 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Getting quotas for project bd7cf7a2010f419688871e4c9469084d. Resources: {'instances', 'cores', 'ram'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:52:45.269203 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-1f84f7f4-0fa0-48eb-83a7-ffcfaf4d9cf5 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Getting quotas for user 38358c71d0eb4d63a008925b18e68adb and project bd7cf7a2010f419688871e4c9469084d. Resources: {'instances', 'cores', 'ram'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:52:45.327058 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-1f84f7f4-0fa0-48eb-83a7-ffcfaf4d9cf5 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Going to run 1 instances... {{(pid=136341) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:52:45.329220 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-1f84f7f4-0fa0-48eb-83a7-ffcfaf4d9cf5 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='454323ea-a7c2-4fcf-b4a1-24de648ea204',volume_size=None,volume_type=None)] {{(pid=136341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:52:45.843194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-1f84f7f4-0fa0-48eb-83a7-ffcfaf4d9cf5 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.116811 Aug 04 21:52:45.843841 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 488/982] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 4 21:52:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:52:45.852316 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=6 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:52:45.853109 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=4 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:52:45.853797 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:52:45.859146 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f1d649d1-de69-44cd-b0aa-8ce249eb0280 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:45.859848 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-f1d649d1-de69-44cd-b0aa-8ce249eb0280 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:45.925681 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-f1d649d1-de69-44cd-b0aa-8ce249eb0280 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:45.934358 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-f1d649d1-de69-44cd-b0aa-8ce249eb0280 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1088 microversion: 2.1 time: 0.083270 Aug 04 21:52:45.934924 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 495/983] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:45 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1088 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:46.956375 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-959025cf-7ce1-443f-98f9-a9dfa4183399 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:46.956986 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-959025cf-7ce1-443f-98f9-a9dfa4183399 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:47.012301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-959025cf-7ce1-443f-98f9-a9dfa4183399 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:47.019001 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-959025cf-7ce1-443f-98f9-a9dfa4183399 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1088 microversion: 2.1 time: 0.067010 Aug 04 21:52:47.020192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 489/984] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:46 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:48.042211 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-0ee435d8-eecb-4707-af40-27de5a3c4d22 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:48.043088 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-0ee435d8-eecb-4707-af40-27de5a3c4d22 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:48.050709 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0ee435d8-eecb-4707-af40-27de5a3c4d22 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:48.051191 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0ee435d8-eecb-4707-af40-27de5a3c4d22 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:48.051624 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0ee435d8-eecb-4707-af40-27de5a3c4d22 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:48.052324 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0ee435d8-eecb-4707-af40-27de5a3c4d22 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:48.052776 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0ee435d8-eecb-4707-af40-27de5a3c4d22 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:48.053202 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0ee435d8-eecb-4707-af40-27de5a3c4d22 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:48.116759 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0ee435d8-eecb-4707-af40-27de5a3c4d22 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:48.125201 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-0ee435d8-eecb-4707-af40-27de5a3c4d22 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1186 microversion: 2.1 time: 0.087656 Aug 04 21:52:48.125764 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 496/985] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:48 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:49.147406 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-70171556-e7a0-4bbe-85ae-cd1ed7739446 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:49.148125 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-70171556-e7a0-4bbe-85ae-cd1ed7739446 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:49.155749 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-70171556-e7a0-4bbe-85ae-cd1ed7739446 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:49.156212 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-70171556-e7a0-4bbe-85ae-cd1ed7739446 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:49.156649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-70171556-e7a0-4bbe-85ae-cd1ed7739446 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:49.157349 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-70171556-e7a0-4bbe-85ae-cd1ed7739446 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:49.157802 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-70171556-e7a0-4bbe-85ae-cd1ed7739446 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:49.158251 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-70171556-e7a0-4bbe-85ae-cd1ed7739446 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:49.223739 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-70171556-e7a0-4bbe-85ae-cd1ed7739446 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:49.231424 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-70171556-e7a0-4bbe-85ae-cd1ed7739446 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1204 microversion: 2.1 time: 0.088031 Aug 04 21:52:49.232028 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 490/986] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:49 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1204 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:50.253842 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-edc6006d-cc6d-4dea-84e9-dbd8c9b926b9 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:50.254536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-edc6006d-cc6d-4dea-84e9-dbd8c9b926b9 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:50.256202 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-a1fc7a1a-ea38-476d-a2cb-fd78d726a1a0 req-f75afbe5-837c-49b6-8c25-849ecb019808 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028c5cd4-1e11-4bde-8f66-4fdf8ef236fd", "tag": "76694182-b548-439d-b9e0-08a5f1cbd3f7"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:52:50.266066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-edc6006d-cc6d-4dea-84e9-dbd8c9b926b9 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:50.266611 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-edc6006d-cc6d-4dea-84e9-dbd8c9b926b9 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:50.267207 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-edc6006d-cc6d-4dea-84e9-dbd8c9b926b9 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:50.267920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-edc6006d-cc6d-4dea-84e9-dbd8c9b926b9 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:50.268381 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-edc6006d-cc6d-4dea-84e9-dbd8c9b926b9 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:50.268879 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-edc6006d-cc6d-4dea-84e9-dbd8c9b926b9 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:50.276400 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-a1fc7a1a-ea38-476d-a2cb-fd78d726a1a0 req-f75afbe5-837c-49b6-8c25-849ecb019808 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:50.277554 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-a1fc7a1a-ea38-476d-a2cb-fd78d726a1a0 req-f75afbe5-837c-49b6-8c25-849ecb019808 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:50.278090 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-a1fc7a1a-ea38-476d-a2cb-fd78d726a1a0 req-f75afbe5-837c-49b6-8c25-849ecb019808 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:50.289729 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-a1fc7a1a-ea38-476d-a2cb-fd78d726a1a0 req-f75afbe5-837c-49b6-8c25-849ecb019808 service nova] Creating event network-changed:76694182-b548-439d-b9e0-08a5f1cbd3f7 for instance 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd on hv-cinder-85220 Aug 04 21:52:50.297841 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-a1fc7a1a-ea38-476d-a2cb-fd78d726a1a0 req-f75afbe5-837c-49b6-8c25-849ecb019808 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046572 Aug 04 21:52:50.298764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 491/987] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:52:50.481537 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-edc6006d-cc6d-4dea-84e9-dbd8c9b926b9 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:50.489354 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-edc6006d-cc6d-4dea-84e9-dbd8c9b926b9 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1272 microversion: 2.1 time: 0.239647 Aug 04 21:52:50.489921 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 497/988] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:50 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:52:51.514736 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-bcf784fb-5d1b-4e9c-ad74-6727bd20e5cb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:51.515422 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-bcf784fb-5d1b-4e9c-ad74-6727bd20e5cb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:51.521698 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bcf784fb-5d1b-4e9c-ad74-6727bd20e5cb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:51.526556 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bcf784fb-5d1b-4e9c-ad74-6727bd20e5cb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:51.526556 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bcf784fb-5d1b-4e9c-ad74-6727bd20e5cb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:51.526556 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bcf784fb-5d1b-4e9c-ad74-6727bd20e5cb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:51.526556 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bcf784fb-5d1b-4e9c-ad74-6727bd20e5cb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:51.527682 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bcf784fb-5d1b-4e9c-ad74-6727bd20e5cb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:51.660458 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-bcf784fb-5d1b-4e9c-ad74-6727bd20e5cb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:51.668409 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-bcf784fb-5d1b-4e9c-ad74-6727bd20e5cb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1260 microversion: 2.1 time: 0.159081 Aug 04 21:52:51.668962 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 492/989] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:51 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:52.689505 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-799c5f38-ff7d-419f-9991-919a3215a46e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:52.690123 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-799c5f38-ff7d-419f-9991-919a3215a46e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:52.696571 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-799c5f38-ff7d-419f-9991-919a3215a46e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:52.697043 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-799c5f38-ff7d-419f-9991-919a3215a46e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:52.697472 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-799c5f38-ff7d-419f-9991-919a3215a46e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:52.698190 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-799c5f38-ff7d-419f-9991-919a3215a46e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:52.698668 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-799c5f38-ff7d-419f-9991-919a3215a46e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:52.699084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-799c5f38-ff7d-419f-9991-919a3215a46e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:52.840637 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-799c5f38-ff7d-419f-9991-919a3215a46e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:52.853961 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-799c5f38-ff7d-419f-9991-919a3215a46e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1260 microversion: 2.1 time: 0.168179 Aug 04 21:52:52.854629 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 498/990] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:52 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:53.878035 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-348c442f-bfc7-4a9a-afc3-f17815750ef7 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:53.878588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-348c442f-bfc7-4a9a-afc3-f17815750ef7 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:53.885233 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-348c442f-bfc7-4a9a-afc3-f17815750ef7 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:53.885708 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-348c442f-bfc7-4a9a-afc3-f17815750ef7 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:53.886225 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-348c442f-bfc7-4a9a-afc3-f17815750ef7 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:53.887452 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-348c442f-bfc7-4a9a-afc3-f17815750ef7 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:53.887898 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-348c442f-bfc7-4a9a-afc3-f17815750ef7 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:53.888316 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-348c442f-bfc7-4a9a-afc3-f17815750ef7 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:54.020735 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-348c442f-bfc7-4a9a-afc3-f17815750ef7 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:54.028274 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-348c442f-bfc7-4a9a-afc3-f17815750ef7 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1260 microversion: 2.1 time: 0.154293 Aug 04 21:52:54.028835 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 493/991] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:53 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:55.048261 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-18674e4d-144d-4eee-8f8e-e926afc4ca0d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:55.048904 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-18674e4d-144d-4eee-8f8e-e926afc4ca0d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:55.055277 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-18674e4d-144d-4eee-8f8e-e926afc4ca0d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:55.055755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-18674e4d-144d-4eee-8f8e-e926afc4ca0d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:55.056188 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-18674e4d-144d-4eee-8f8e-e926afc4ca0d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:55.056874 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-18674e4d-144d-4eee-8f8e-e926afc4ca0d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:55.057328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-18674e4d-144d-4eee-8f8e-e926afc4ca0d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:55.057750 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-18674e4d-144d-4eee-8f8e-e926afc4ca0d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:55.202878 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-18674e4d-144d-4eee-8f8e-e926afc4ca0d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:55.210350 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-18674e4d-144d-4eee-8f8e-e926afc4ca0d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1260 microversion: 2.1 time: 0.166037 Aug 04 21:52:55.210915 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 499/992] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:55 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:56.230443 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-97cdab5d-a86a-4c94-97e1-2748f8c14a59 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:56.231074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-97cdab5d-a86a-4c94-97e1-2748f8c14a59 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:56.233471 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=2 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:52:56.238220 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-97cdab5d-a86a-4c94-97e1-2748f8c14a59 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:56.238695 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-97cdab5d-a86a-4c94-97e1-2748f8c14a59 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:56.239129 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-97cdab5d-a86a-4c94-97e1-2748f8c14a59 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:56.239806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-97cdab5d-a86a-4c94-97e1-2748f8c14a59 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:56.240250 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-97cdab5d-a86a-4c94-97e1-2748f8c14a59 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:56.240663 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-97cdab5d-a86a-4c94-97e1-2748f8c14a59 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:56.381520 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-97cdab5d-a86a-4c94-97e1-2748f8c14a59 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:56.389919 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-97cdab5d-a86a-4c94-97e1-2748f8c14a59 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1260 microversion: 2.1 time: 0.163588 Aug 04 21:52:56.390602 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 494/993] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:56 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:57.412273 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-10db1888-f68d-4e28-a5c0-40dfda8caee1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:57.412817 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-10db1888-f68d-4e28-a5c0-40dfda8caee1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:57.419391 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-10db1888-f68d-4e28-a5c0-40dfda8caee1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:57.419870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-10db1888-f68d-4e28-a5c0-40dfda8caee1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:57.420297 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-10db1888-f68d-4e28-a5c0-40dfda8caee1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:57.420984 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-10db1888-f68d-4e28-a5c0-40dfda8caee1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:57.421434 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-10db1888-f68d-4e28-a5c0-40dfda8caee1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:57.421852 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-10db1888-f68d-4e28-a5c0-40dfda8caee1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:57.711896 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-10db1888-f68d-4e28-a5c0-40dfda8caee1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:57.719882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-10db1888-f68d-4e28-a5c0-40dfda8caee1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1260 microversion: 2.1 time: 0.311724 Aug 04 21:52:57.720445 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 500/994] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:57 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1260 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:58.741414 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-59eed97e-1cc3-4d97-a358-fea9265a1e33 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:58.742023 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-59eed97e-1cc3-4d97-a358-fea9265a1e33 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:58.743841 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=8 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:52:58.750337 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-59eed97e-1cc3-4d97-a358-fea9265a1e33 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:58.750817 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-59eed97e-1cc3-4d97-a358-fea9265a1e33 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:58.751244 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-59eed97e-1cc3-4d97-a358-fea9265a1e33 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:58.751932 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-59eed97e-1cc3-4d97-a358-fea9265a1e33 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:58.752373 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-59eed97e-1cc3-4d97-a358-fea9265a1e33 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:58.752789 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-59eed97e-1cc3-4d97-a358-fea9265a1e33 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:58.891651 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-59eed97e-1cc3-4d97-a358-fea9265a1e33 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:52:58.899174 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-59eed97e-1cc3-4d97-a358-fea9265a1e33 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1260 microversion: 2.1 time: 0.161618 Aug 04 21:52:58.899732 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 495/995] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:58 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:52:59.921079 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-08a6fd1f-b59f-4edb-969f-1fc85d35dd29 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:52:59.921688 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-08a6fd1f-b59f-4edb-969f-1fc85d35dd29 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:52:59.923528 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=2 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:52:59.928910 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08a6fd1f-b59f-4edb-969f-1fc85d35dd29 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:59.929387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08a6fd1f-b59f-4edb-969f-1fc85d35dd29 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:59.929815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08a6fd1f-b59f-4edb-969f-1fc85d35dd29 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:52:59.930539 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08a6fd1f-b59f-4edb-969f-1fc85d35dd29 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:52:59.930985 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08a6fd1f-b59f-4edb-969f-1fc85d35dd29 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:52:59.931401 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08a6fd1f-b59f-4edb-969f-1fc85d35dd29 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:00.066130 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-08a6fd1f-b59f-4edb-969f-1fc85d35dd29 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:53:00.074557 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-08a6fd1f-b59f-4edb-969f-1fc85d35dd29 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1260 microversion: 2.1 time: 0.157364 Aug 04 21:53:00.075369 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 501/996] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:52:59 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:53:01.096765 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-8d2b56aa-8e2b-4101-925c-97dca3a5860f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:01.097467 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-8d2b56aa-8e2b-4101-925c-97dca3a5860f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:01.103892 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8d2b56aa-8e2b-4101-925c-97dca3a5860f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:01.104400 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8d2b56aa-8e2b-4101-925c-97dca3a5860f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:01.105415 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8d2b56aa-8e2b-4101-925c-97dca3a5860f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:01.106191 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8d2b56aa-8e2b-4101-925c-97dca3a5860f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:01.106646 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8d2b56aa-8e2b-4101-925c-97dca3a5860f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:01.107069 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8d2b56aa-8e2b-4101-925c-97dca3a5860f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:01.239372 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8d2b56aa-8e2b-4101-925c-97dca3a5860f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:53:01.247046 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-8d2b56aa-8e2b-4101-925c-97dca3a5860f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1260 microversion: 2.1 time: 0.154181 Aug 04 21:53:01.248029 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 496/997] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:53:01 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:53:01.539876 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-dee26030-6bd1-4333-beaa-df7ba7d85abe req-7773be70-7738-41ca-a689-1ef83a7ac8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028c5cd4-1e11-4bde-8f66-4fdf8ef236fd", "name": "network-vif-plugged", "status": "completed", "tag": "76694182-b548-439d-b9e0-08a5f1cbd3f7"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:53:01.550230 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-dee26030-6bd1-4333-beaa-df7ba7d85abe req-7773be70-7738-41ca-a689-1ef83a7ac8e5 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:01.550707 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-dee26030-6bd1-4333-beaa-df7ba7d85abe req-7773be70-7738-41ca-a689-1ef83a7ac8e5 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:01.551133 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-dee26030-6bd1-4333-beaa-df7ba7d85abe req-7773be70-7738-41ca-a689-1ef83a7ac8e5 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:01.562620 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-dee26030-6bd1-4333-beaa-df7ba7d85abe req-7773be70-7738-41ca-a689-1ef83a7ac8e5 service nova] Creating event network-vif-plugged:76694182-b548-439d-b9e0-08a5f1cbd3f7 for instance 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd on hv-cinder-85220 Aug 04 21:53:01.570153 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-dee26030-6bd1-4333-beaa-df7ba7d85abe req-7773be70-7738-41ca-a689-1ef83a7ac8e5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089500 Aug 04 21:53:01.570153 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 502/998] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:53:02.269911 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-0c209084-0f5a-4a0a-b0a6-7765c4b5bbbb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:02.270534 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-0c209084-0f5a-4a0a-b0a6-7765c4b5bbbb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:02.277415 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0c209084-0f5a-4a0a-b0a6-7765c4b5bbbb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:02.277898 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0c209084-0f5a-4a0a-b0a6-7765c4b5bbbb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:02.278949 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0c209084-0f5a-4a0a-b0a6-7765c4b5bbbb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:02.279622 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0c209084-0f5a-4a0a-b0a6-7765c4b5bbbb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:02.280066 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0c209084-0f5a-4a0a-b0a6-7765c4b5bbbb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:02.280481 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0c209084-0f5a-4a0a-b0a6-7765c4b5bbbb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:02.416970 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-0c209084-0f5a-4a0a-b0a6-7765c4b5bbbb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:53:02.424996 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-0c209084-0f5a-4a0a-b0a6-7765c4b5bbbb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1260 microversion: 2.1 time: 0.160044 Aug 04 21:53:02.425556 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 497/999] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:53:02 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:53:03.445939 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f58d6e5f-e482-41fe-a990-8c7a7a30e87f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:03.446683 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-f58d6e5f-e482-41fe-a990-8c7a7a30e87f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:03.453401 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f58d6e5f-e482-41fe-a990-8c7a7a30e87f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:03.453878 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f58d6e5f-e482-41fe-a990-8c7a7a30e87f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:03.454328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f58d6e5f-e482-41fe-a990-8c7a7a30e87f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:03.455003 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f58d6e5f-e482-41fe-a990-8c7a7a30e87f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:03.455446 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f58d6e5f-e482-41fe-a990-8c7a7a30e87f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:03.455862 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f58d6e5f-e482-41fe-a990-8c7a7a30e87f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:03.593948 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-f58d6e5f-e482-41fe-a990-8c7a7a30e87f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:53:03.601490 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-f58d6e5f-e482-41fe-a990-8c7a7a30e87f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1260 microversion: 2.1 time: 0.160196 Aug 04 21:53:03.602063 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 503/1000] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:53:03 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:53:04.623333 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-8ac00f4a-0301-41c0-b997-b70da5d9ed95 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:04.623920 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-8ac00f4a-0301-41c0-b997-b70da5d9ed95 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:04.630309 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8ac00f4a-0301-41c0-b997-b70da5d9ed95 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:04.630792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8ac00f4a-0301-41c0-b997-b70da5d9ed95 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:04.631226 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8ac00f4a-0301-41c0-b997-b70da5d9ed95 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:04.631908 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8ac00f4a-0301-41c0-b997-b70da5d9ed95 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:04.632362 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8ac00f4a-0301-41c0-b997-b70da5d9ed95 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:04.632782 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8ac00f4a-0301-41c0-b997-b70da5d9ed95 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:04.770747 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8ac00f4a-0301-41c0-b997-b70da5d9ed95 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:53:04.778366 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-8ac00f4a-0301-41c0-b997-b70da5d9ed95 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1445 microversion: 2.1 time: 0.159153 Aug 04 21:53:04.778876 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 498/1001] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:53:04 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1445 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:53:04.799206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4e4c11ba-6458-44b5-b4b9-9c515d68e59f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:04.799900 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4e4c11ba-6458-44b5-b4b9-9c515d68e59f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:04.806311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4e4c11ba-6458-44b5-b4b9-9c515d68e59f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:04.806787 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4e4c11ba-6458-44b5-b4b9-9c515d68e59f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:04.807212 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4e4c11ba-6458-44b5-b4b9-9c515d68e59f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:04.807894 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4e4c11ba-6458-44b5-b4b9-9c515d68e59f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:04.808336 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4e4c11ba-6458-44b5-b4b9-9c515d68e59f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:04.808752 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4e4c11ba-6458-44b5-b4b9-9c515d68e59f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:04.944019 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4e4c11ba-6458-44b5-b4b9-9c515d68e59f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:53:04.952505 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4e4c11ba-6458-44b5-b4b9-9c515d68e59f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1445 microversion: 2.1 time: 0.157867 Aug 04 21:53:04.953060 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 504/1002] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:53:04 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1445 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:53:07.063787 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-db0332ad-5091-4a4e-8909-7d4f6a10eed0 req-b0240132-bcf2-4f68-8db3-f1fb44addf11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028c5cd4-1e11-4bde-8f66-4fdf8ef236fd", "tag": "76694182-b548-439d-b9e0-08a5f1cbd3f7"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:53:07.073919 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-db0332ad-5091-4a4e-8909-7d4f6a10eed0 req-b0240132-bcf2-4f68-8db3-f1fb44addf11 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:07.074428 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-db0332ad-5091-4a4e-8909-7d4f6a10eed0 req-b0240132-bcf2-4f68-8db3-f1fb44addf11 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:07.074875 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-db0332ad-5091-4a4e-8909-7d4f6a10eed0 req-b0240132-bcf2-4f68-8db3-f1fb44addf11 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:07.086550 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-db0332ad-5091-4a4e-8909-7d4f6a10eed0 req-b0240132-bcf2-4f68-8db3-f1fb44addf11 service nova] Creating event network-changed:76694182-b548-439d-b9e0-08a5f1cbd3f7 for instance 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd on hv-cinder-85220 Aug 04 21:53:07.091640 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-db0332ad-5091-4a4e-8909-7d4f6a10eed0 req-b0240132-bcf2-4f68-8db3-f1fb44addf11 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032525 Aug 04 21:53:07.092445 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 499/1003] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:53:15.778932 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-72b211a8-a757-4abd-bd82-f5228f46e587 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-502840871"}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:53:15.779592 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-72b211a8-a757-4abd-bd82-f5228f46e587 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:15.781534 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=22 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:53:15.782287 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=50 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:53:15.787568 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-72b211a8-a757-4abd-bd82-f5228f46e587 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:15.788053 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-72b211a8-a757-4abd-bd82-f5228f46e587 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:15.788500 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-72b211a8-a757-4abd-bd82-f5228f46e587 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:15.789167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-72b211a8-a757-4abd-bd82-f5228f46e587 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:15.789618 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-72b211a8-a757-4abd-bd82-f5228f46e587 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:15.790063 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-72b211a8-a757-4abd-bd82-f5228f46e587 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:15.923706 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.network.security_group_api [None req-72b211a8-a757-4abd-bd82-f5228f46e587 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Removing security group 0d1f37aa-6359-47cb-995a-898bdb479595 from port 85083dfa-01f6-49d9-a92d-4bfee46f59b9 Aug 04 21:53:16.293467 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-72b211a8-a757-4abd-bd82-f5228f46e587 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "POST /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28/action" status: 202 len: 0 microversion: 2.1 time: 0.518679 Aug 04 21:53:16.294398 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 505/1004] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 4 21:53:15 2022] POST /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:53:16.302668 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-e50be28a-304e-4988-bad1-341c64bf36ac req-31499e54-b696-4c54-817c-8c2ebc0d1406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b239b668-0156-411a-8a3b-45ce0c119e28", "tag": "85083dfa-01f6-49d9-a92d-4bfee46f59b9"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:53:16.308597 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:53:16.322099 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-e50be28a-304e-4988-bad1-341c64bf36ac req-31499e54-b696-4c54-817c-8c2ebc0d1406 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:16.322674 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-e50be28a-304e-4988-bad1-341c64bf36ac req-31499e54-b696-4c54-817c-8c2ebc0d1406 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:16.323138 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-e50be28a-304e-4988-bad1-341c64bf36ac req-31499e54-b696-4c54-817c-8c2ebc0d1406 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:16.340093 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=55 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:53:16.357264 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-e50be28a-304e-4988-bad1-341c64bf36ac req-31499e54-b696-4c54-817c-8c2ebc0d1406 service nova] Creating event network-changed:85083dfa-01f6-49d9-a92d-4bfee46f59b9 for instance b239b668-0156-411a-8a3b-45ce0c119e28 on hv-cinder-85220 Aug 04 21:53:16.369743 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-e50be28a-304e-4988-bad1-341c64bf36ac req-31499e54-b696-4c54-817c-8c2ebc0d1406 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071613 Aug 04 21:53:16.370390 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 500/1005] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:53:17.833773 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f66a4123-dcc6-441f-8273-5f8d4f3ec98e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:17.841552 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-f66a4123-dcc6-441f-8273-5f8d4f3ec98e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:17.849936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f66a4123-dcc6-441f-8273-5f8d4f3ec98e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:17.850451 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f66a4123-dcc6-441f-8273-5f8d4f3ec98e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:17.850880 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f66a4123-dcc6-441f-8273-5f8d4f3ec98e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:17.851580 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f66a4123-dcc6-441f-8273-5f8d4f3ec98e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:17.852026 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f66a4123-dcc6-441f-8273-5f8d4f3ec98e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:17.852440 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f66a4123-dcc6-441f-8273-5f8d4f3ec98e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:17.906836 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-c6de6ee1-9f2b-46e4-b9a5-acea72c4a4e7 req-6feff0af-9bbe-46d0-862b-fd16b8eef16b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b239b668-0156-411a-8a3b-45ce0c119e28", "tag": "85083dfa-01f6-49d9-a92d-4bfee46f59b9"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:53:17.916793 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-c6de6ee1-9f2b-46e4-b9a5-acea72c4a4e7 req-6feff0af-9bbe-46d0-862b-fd16b8eef16b service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:17.917264 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-c6de6ee1-9f2b-46e4-b9a5-acea72c4a4e7 req-6feff0af-9bbe-46d0-862b-fd16b8eef16b service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:17.917685 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-c6de6ee1-9f2b-46e4-b9a5-acea72c4a4e7 req-6feff0af-9bbe-46d0-862b-fd16b8eef16b service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:17.929493 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-c6de6ee1-9f2b-46e4-b9a5-acea72c4a4e7 req-6feff0af-9bbe-46d0-862b-fd16b8eef16b service nova] Creating event network-changed:85083dfa-01f6-49d9-a92d-4bfee46f59b9 for instance b239b668-0156-411a-8a3b-45ce0c119e28 on hv-cinder-85220 Aug 04 21:53:17.934426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-c6de6ee1-9f2b-46e4-b9a5-acea72c4a4e7 req-6feff0af-9bbe-46d0-862b-fd16b8eef16b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098850 Aug 04 21:53:17.935188 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 501/1006] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:53:17.959704 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-f66a4123-dcc6-441f-8273-5f8d4f3ec98e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lazy-loading 'services' on Instance uuid b239b668-0156-411a-8a3b-45ce0c119e28 {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:53:18.188097 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-f66a4123-dcc6-441f-8273-5f8d4f3ec98e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28/os-volume_attachments/4de2fd67-3734-4c79-869a-f1500158d6e0" status: 202 len: 0 microversion: 2.1 time: 0.358469 Aug 04 21:53:18.194528 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 506/1007] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 4 21:53:17 2022] DELETE /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28/os-volume_attachments/4de2fd67-3734-4c79-869a-f1500158d6e0 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:53:18.215768 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a3e8369c-567d-4265-80c4-04d9936eca7d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:18.219163 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a3e8369c-567d-4265-80c4-04d9936eca7d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:18.227532 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a3e8369c-567d-4265-80c4-04d9936eca7d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:18.228125 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a3e8369c-567d-4265-80c4-04d9936eca7d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:18.228636 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a3e8369c-567d-4265-80c4-04d9936eca7d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:18.229416 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a3e8369c-567d-4265-80c4-04d9936eca7d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:18.229966 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a3e8369c-567d-4265-80c4-04d9936eca7d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:18.230478 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a3e8369c-567d-4265-80c4-04d9936eca7d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:18.264745 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a3e8369c-567d-4265-80c4-04d9936eca7d tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061958 Aug 04 21:53:18.265569 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 502/1008] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:53:18 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:53:19.280036 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ab39209c-d25c-4c71-b71e-2e6ca5511aff tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:19.282449 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ab39209c-d25c-4c71-b71e-2e6ca5511aff tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:19.288995 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ab39209c-d25c-4c71-b71e-2e6ca5511aff tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:19.289475 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ab39209c-d25c-4c71-b71e-2e6ca5511aff tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:19.292324 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ab39209c-d25c-4c71-b71e-2e6ca5511aff tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:19.292324 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ab39209c-d25c-4c71-b71e-2e6ca5511aff tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:19.292324 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ab39209c-d25c-4c71-b71e-2e6ca5511aff tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:19.292324 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ab39209c-d25c-4c71-b71e-2e6ca5511aff tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:19.321640 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ab39209c-d25c-4c71-b71e-2e6ca5511aff tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046400 Aug 04 21:53:19.322220 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 507/1009] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:53:19 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:53:20.334843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c84799f4-8259-4636-ac8f-412febab9cc4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:20.336988 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c84799f4-8259-4636-ac8f-412febab9cc4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:20.343255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c84799f4-8259-4636-ac8f-412febab9cc4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:20.343732 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c84799f4-8259-4636-ac8f-412febab9cc4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:20.344218 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c84799f4-8259-4636-ac8f-412febab9cc4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:20.344900 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c84799f4-8259-4636-ac8f-412febab9cc4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:20.345342 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c84799f4-8259-4636-ac8f-412febab9cc4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:20.345754 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c84799f4-8259-4636-ac8f-412febab9cc4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:20.375243 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c84799f4-8259-4636-ac8f-412febab9cc4 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045029 Aug 04 21:53:20.375802 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 503/1010] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:53:20 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:53:20.387051 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4a7d917b-40e1-4836-a752-f8c0ac082ab7 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:20.387596 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4a7d917b-40e1-4836-a752-f8c0ac082ab7 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:20.393966 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4a7d917b-40e1-4836-a752-f8c0ac082ab7 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:20.394469 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4a7d917b-40e1-4836-a752-f8c0ac082ab7 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:20.394899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4a7d917b-40e1-4836-a752-f8c0ac082ab7 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:20.395581 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4a7d917b-40e1-4836-a752-f8c0ac082ab7 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:20.396026 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4a7d917b-40e1-4836-a752-f8c0ac082ab7 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:20.396442 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4a7d917b-40e1-4836-a752-f8c0ac082ab7 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:20.470957 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-4a7d917b-40e1-4836-a752-f8c0ac082ab7 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] HTTP exception thrown: Instance b239b668-0156-411a-8a3b-45ce0c119e28 is not attached to volume 4de2fd67-3734-4c79-869a-f1500158d6e0 Aug 04 21:53:20.473359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4a7d917b-40e1-4836-a752-f8c0ac082ab7 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Request method failure captured: Aug 04 21:53:20.473359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: DELETE /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28/os-volume_attachments/4de2fd67-3734-4c79-869a-f1500158d6e0 HTTP/1.1 Aug 04 21:53:20.473359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:53:20.473359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:53:20.473359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:53:20.473359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:53:20.473359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:53:20.473359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:53:20.473359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:53:20.473359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:53:20.473359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7D7ha6QNSCXkkKJ0-ruhY_C2NgQtm0N5el9nJ6at5Vj9hnko0YzBE0OACJMOqYFt4qAZjDxQYpfD8pWY-54vZYuriqYuASkVkbV7MxcuykM_L_w-OcmBagCrPChZJX4-8-ncBsv9HTAoauelf7o-VJh7kURZuWJMr0c73W0bMib9_vY Aug 04 21:53:20.473359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:53:20.473359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:53:20.473359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:53:20.473359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:53:20.473359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:53:20.473359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:53:20.473359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: b1685a61dd0844269efb39407dcd1e67 Aug 04 21:53:20.473359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-TestMinimumBasicScenario-665344925 Aug 04 21:53:20.473359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:53:20.473359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:53:20.475057 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b1685a61dd0844269efb39407dcd1e67", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b1685a61dd0844269efb39407dcd1e67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b1685a61dd0844269efb39407dcd1e67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b1685a61dd0844269efb39407dcd1e67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:53:20.475057 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-TestMinimumBasicScenario-665344925 Aug 04 21:53:20.475057 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: b1685a61dd0844269efb39407dcd1e67 Aug 04 21:53:20.475057 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-TestMinimumBasicScenario-665344925 Aug 04 21:53:20.475057 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-TestMinimumBasicScenario-665344925-project Aug 04 21:53:20.475057 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:53:20.475057 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:53:20.475057 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: 11ce89a0a9254498977b9ef531aa3b2e Aug 04 21:53:20.475057 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-TestMinimumBasicScenario-665344925-project Aug 04 21:53:20.475057 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:53:20.475057 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance b239b668-0156-411a-8a3b-45ce0c119e28 is not attached to volume 4de2fd67-3734-4c79-869a-f1500158d6e0 Aug 04 21:53:20.475986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'server_id': 'b239b668-0156-411a-8a3b-45ce0c119e28', 'id': '4de2fd67-3734-4c79-869a-f1500158d6e0'} Aug 04 21:53:20.475986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:53:20.475986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:53:20.475986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 21:53:20.475986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 21:53:20.475986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 21:53:20.475986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 21:53:20.475986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 21:53:20.475986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 21:53:20.475986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4de2fd67-3734-4c79-869a-f1500158d6e0. Aug 04 21:53:20.475986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:53:20.475986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:53:20.475986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:53:20.475986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:53:20.475986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:53:20.475986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:53:20.475986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:53:20.475986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:53:20.475986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:53:20.477478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:53:20.477478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 21:53:20.477478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 21:53:20.477478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b239b668-0156-411a-8a3b-45ce0c119e28 is not attached to volume 4de2fd67-3734-4c79-869a-f1500158d6e0 Aug 04 21:53:20.477478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:53:20.477478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:53:20.477478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:53:20.477478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:53:20.477478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:53:20.477478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:53:20.477478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:53:20.477478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:53:20.477478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b239b668-0156-411a-8a3b-45ce0c119e28 is not attached to volume 4de2fd67-3734-4c79-869a-f1500158d6e0 Aug 04 21:53:20.477478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:53:20.477478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4a7d917b-40e1-4836-a752-f8c0ac082ab7 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Returning 404 to user: Instance b239b668-0156-411a-8a3b-45ce0c119e28 is not attached to volume 4de2fd67-3734-4c79-869a-f1500158d6e0 {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:53:20.478705 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4a7d917b-40e1-4836-a752-f8c0ac082ab7 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28/os-volume_attachments/4de2fd67-3734-4c79-869a-f1500158d6e0" status: 404 len: 154 microversion: 2.1 time: 0.091684 Aug 04 21:53:20.478705 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 508/1011] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 4 21:53:20 2022] DELETE /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28/os-volume_attachments/4de2fd67-3734-4c79-869a-f1500158d6e0 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:53:21.732168 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-42335ae3-3c3e-4f95-83bc-49f981973da8 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:21.732686 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-42335ae3-3c3e-4f95-83bc-49f981973da8 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:21.739771 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-42335ae3-3c3e-4f95-83bc-49f981973da8 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:21.740191 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-42335ae3-3c3e-4f95-83bc-49f981973da8 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:21.740623 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-42335ae3-3c3e-4f95-83bc-49f981973da8 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:21.741301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-42335ae3-3c3e-4f95-83bc-49f981973da8 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:21.741756 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-42335ae3-3c3e-4f95-83bc-49f981973da8 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:21.742206 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-42335ae3-3c3e-4f95-83bc-49f981973da8 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:21.766752 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-42335ae3-3c3e-4f95-83bc-49f981973da8 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Going to try to terminate instance {{(pid=136341) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:53:22.061057 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-42335ae3-3c3e-4f95-83bc-49f981973da8 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 204 len: 0 microversion: 2.1 time: 0.332519 Aug 04 21:53:22.061646 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 504/1012] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:53:21 2022] DELETE /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:53:22.070683 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ad26918b-3dd7-4a96-936d-f26f6c15a2a2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:22.072463 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ad26918b-3dd7-4a96-936d-f26f6c15a2a2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:22.077872 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ad26918b-3dd7-4a96-936d-f26f6c15a2a2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:22.078386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ad26918b-3dd7-4a96-936d-f26f6c15a2a2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:22.078817 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ad26918b-3dd7-4a96-936d-f26f6c15a2a2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:22.079506 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ad26918b-3dd7-4a96-936d-f26f6c15a2a2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:22.079953 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ad26918b-3dd7-4a96-936d-f26f6c15a2a2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:22.080367 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ad26918b-3dd7-4a96-936d-f26f6c15a2a2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:22.227300 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ad26918b-3dd7-4a96-936d-f26f6c15a2a2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:53:22.234830 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ad26918b-3dd7-4a96-936d-f26f6c15a2a2 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1556 microversion: 2.1 time: 0.168918 Aug 04 21:53:22.235389 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 509/1013] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:53:22 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:53:23.257471 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-93112798-fc24-472f-af61-eabe6b40bbc6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:23.258238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-93112798-fc24-472f-af61-eabe6b40bbc6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:23.264110 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-93112798-fc24-472f-af61-eabe6b40bbc6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:23.264588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-93112798-fc24-472f-af61-eabe6b40bbc6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:23.265023 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-93112798-fc24-472f-af61-eabe6b40bbc6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:23.265708 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-93112798-fc24-472f-af61-eabe6b40bbc6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:23.266192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-93112798-fc24-472f-af61-eabe6b40bbc6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:23.266614 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-93112798-fc24-472f-af61-eabe6b40bbc6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:23.396798 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-93112798-fc24-472f-af61-eabe6b40bbc6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:53:23.404223 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-93112798-fc24-472f-af61-eabe6b40bbc6 tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1556 microversion: 2.1 time: 0.151530 Aug 04 21:53:23.404769 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 505/1014] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:53:23 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:53:24.424979 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-0e8988d4-d94b-458b-aba6-16a74817ddfd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:24.426248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-0e8988d4-d94b-458b-aba6-16a74817ddfd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:24.433036 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0e8988d4-d94b-458b-aba6-16a74817ddfd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:24.433523 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0e8988d4-d94b-458b-aba6-16a74817ddfd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:24.433965 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0e8988d4-d94b-458b-aba6-16a74817ddfd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:24.434686 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0e8988d4-d94b-458b-aba6-16a74817ddfd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:24.435138 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0e8988d4-d94b-458b-aba6-16a74817ddfd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:24.435559 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0e8988d4-d94b-458b-aba6-16a74817ddfd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:24.637391 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0e8988d4-d94b-458b-aba6-16a74817ddfd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:53:24.644903 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-0e8988d4-d94b-458b-aba6-16a74817ddfd tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1556 microversion: 2.1 time: 0.223963 Aug 04 21:53:24.645588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 510/1015] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:53:24 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1556 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:53:25.072720 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-f598c2aa-f43b-4e95-807a-520f36d8abda req-26b49f49-3156-45b4-92ac-39379fd957e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b239b668-0156-411a-8a3b-45ce0c119e28", "name": "network-vif-deleted", "tag": "85083dfa-01f6-49d9-a92d-4bfee46f59b9"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:53:25.083176 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-f598c2aa-f43b-4e95-807a-520f36d8abda req-26b49f49-3156-45b4-92ac-39379fd957e7 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:25.083763 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-f598c2aa-f43b-4e95-807a-520f36d8abda req-26b49f49-3156-45b4-92ac-39379fd957e7 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:25.084187 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-f598c2aa-f43b-4e95-807a-520f36d8abda req-26b49f49-3156-45b4-92ac-39379fd957e7 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:25.095060 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-f598c2aa-f43b-4e95-807a-520f36d8abda req-26b49f49-3156-45b4-92ac-39379fd957e7 service nova] Creating event network-vif-deleted:85083dfa-01f6-49d9-a92d-4bfee46f59b9 for instance b239b668-0156-411a-8a3b-45ce0c119e28 on hv-cinder-85220 Aug 04 21:53:25.100298 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-f598c2aa-f43b-4e95-807a-520f36d8abda req-26b49f49-3156-45b4-92ac-39379fd957e7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031467 Aug 04 21:53:25.100868 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 506/1016] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:53:25.665657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-672313d4-3053-4ddc-839c-d20e8eb24a7a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:25.666293 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-672313d4-3053-4ddc-839c-d20e8eb24a7a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:25.672609 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-672313d4-3053-4ddc-839c-d20e8eb24a7a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:25.673084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-672313d4-3053-4ddc-839c-d20e8eb24a7a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:25.673512 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-672313d4-3053-4ddc-839c-d20e8eb24a7a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:25.674224 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-672313d4-3053-4ddc-839c-d20e8eb24a7a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:25.674672 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-672313d4-3053-4ddc-839c-d20e8eb24a7a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:25.675089 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-672313d4-3053-4ddc-839c-d20e8eb24a7a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:25.705385 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-672313d4-3053-4ddc-839c-d20e8eb24a7a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:25.705855 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-672313d4-3053-4ddc-839c-d20e8eb24a7a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:25.706316 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-672313d4-3053-4ddc-839c-d20e8eb24a7a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:25.706753 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-672313d4-3053-4ddc-839c-d20e8eb24a7a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lazy-loading 'fault' on Instance uuid b239b668-0156-411a-8a3b-45ce0c119e28 {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:53:25.750398 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-672313d4-3053-4ddc-839c-d20e8eb24a7a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11ce89a0a9254498977b9ef531aa3b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1685a61dd0844269efb39407dcd1e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:53:25.758576 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-672313d4-3053-4ddc-839c-d20e8eb24a7a tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 200 len: 1349 microversion: 2.1 time: 0.096719 Aug 04 21:53:25.759126 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 511/1017] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:53:25 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:53:26.780449 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-def1862d-222e-44f6-9e7b-0ae37c3fc81e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:26.781070 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-def1862d-222e-44f6-9e7b-0ae37c3fc81e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] [instance: b239b668-0156-411a-8a3b-45ce0c119e28] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:26.787640 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-def1862d-222e-44f6-9e7b-0ae37c3fc81e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:26.788137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-def1862d-222e-44f6-9e7b-0ae37c3fc81e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:26.788574 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-def1862d-222e-44f6-9e7b-0ae37c3fc81e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:26.789270 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-def1862d-222e-44f6-9e7b-0ae37c3fc81e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:26.789724 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-def1862d-222e-44f6-9e7b-0ae37c3fc81e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:26.790358 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-def1862d-222e-44f6-9e7b-0ae37c3fc81e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:26.803819 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-def1862d-222e-44f6-9e7b-0ae37c3fc81e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] HTTP exception thrown: Instance b239b668-0156-411a-8a3b-45ce0c119e28 could not be found. Aug 04 21:53:26.805463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-def1862d-222e-44f6-9e7b-0ae37c3fc81e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Request method failure captured: Aug 04 21:53:26.805463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 HTTP/1.1 Aug 04 21:53:26.805463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:53:26.805463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:53:26.805463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:53:26.805463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 21:53:26.805463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:53:26.805463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:53:26.805463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:53:26.805463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:53:26.805463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7D7ha6QNSCXkkKJ0-ruhY_C2NgQtm0N5el9nJ6at5Vj9hnko0YzBE0OACJMOqYFt4qAZjDxQYpfD8pWY-54vZYuriqYuASkVkbV7MxcuykM_L_w-OcmBagCrPChZJX4-8-ncBsv9HTAoauelf7o-VJh7kURZuWJMr0c73W0bMib9_vY Aug 04 21:53:26.805463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:53:26.805463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:53:26.805463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:53:26.805463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:53:26.805463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:53:26.805463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:53:26.805463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: b1685a61dd0844269efb39407dcd1e67 Aug 04 21:53:26.805463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-TestMinimumBasicScenario-665344925 Aug 04 21:53:26.805463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:53:26.805463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:53:26.807814 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b1685a61dd0844269efb39407dcd1e67", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b1685a61dd0844269efb39407dcd1e67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b1685a61dd0844269efb39407dcd1e67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b1685a61dd0844269efb39407dcd1e67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:53:26.807814 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-TestMinimumBasicScenario-665344925 Aug 04 21:53:26.807814 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: b1685a61dd0844269efb39407dcd1e67 Aug 04 21:53:26.807814 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-TestMinimumBasicScenario-665344925 Aug 04 21:53:26.807814 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-TestMinimumBasicScenario-665344925-project Aug 04 21:53:26.807814 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:53:26.807814 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:53:26.807814 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: 11ce89a0a9254498977b9ef531aa3b2e Aug 04 21:53:26.807814 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-TestMinimumBasicScenario-665344925-project Aug 04 21:53:26.807814 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 21:53:26.807814 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Instance b239b668-0156-411a-8a3b-45ce0c119e28 could not be found. Aug 04 21:53:26.807814 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': 'b239b668-0156-411a-8a3b-45ce0c119e28'} Aug 04 21:53:26.809588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:53:26.809588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:53:26.809588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:53:26.809588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:53:26.809588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:53:26.809588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:53:26.809588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:53:26.809588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:53:26.809588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:53:26.809588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:53:26.809588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b239b668-0156-411a-8a3b-45ce0c119e28 could not be found. Aug 04 21:53:26.809588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:53:26.809588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:53:26.809588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:53:26.809588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:53:26.809588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:53:26.809588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:53:26.809588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:53:26.809588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:53:26.809588 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:53:26.812712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:53:26.812712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:53:26.812712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:53:26.812712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:53:26.812712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:53:26.812712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:53:26.812712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:53:26.812712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b239b668-0156-411a-8a3b-45ce0c119e28 could not be found. Aug 04 21:53:26.812712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:53:26.812712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:53:26.812712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:53:26.812712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:53:26.812712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:53:26.812712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:53:26.812712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:53:26.812712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:53:26.812712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b239b668-0156-411a-8a3b-45ce0c119e28 could not be found. Aug 04 21:53:26.812712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:53:26.814686 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-def1862d-222e-44f6-9e7b-0ae37c3fc81e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Returning 404 to user: Instance b239b668-0156-411a-8a3b-45ce0c119e28 could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:53:26.814686 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-def1862d-222e-44f6-9e7b-0ae37c3fc81e tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28" status: 404 len: 111 microversion: 2.1 time: 0.031293 Aug 04 21:53:26.814686 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 507/1018] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:53:26 2022] GET /compute/v2.1/servers/b239b668-0156-411a-8a3b-45ce0c119e28 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:53:26.817140 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4a7b2e1c-e024-43d6-bfbc-532af2d08fcb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] Calling method '.version_select at 0x7f3c14f558b0>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:26.921076 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4a7b2e1c-e024-43d6-bfbc-532af2d08fcb tempest-TestMinimumBasicScenario-665344925 tempest-TestMinimumBasicScenario-665344925-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1941403629" status: 202 len: 0 microversion: 2.1 time: 0.107611 Aug 04 21:53:26.921655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 512/1019] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 4 21:53:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1941403629 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 21:53:39.099461 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-4a011e6a-1082-444a-975c-618f9f4f1a12 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:39.100052 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-4a011e6a-1082-444a-975c-618f9f4f1a12 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:39.102509 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:53:39.103154 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:53:39.107771 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4a011e6a-1082-444a-975c-618f9f4f1a12 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:39.108243 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4a011e6a-1082-444a-975c-618f9f4f1a12 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:39.108669 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4a011e6a-1082-444a-975c-618f9f4f1a12 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:39.109347 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4a011e6a-1082-444a-975c-618f9f4f1a12 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:39.109794 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4a011e6a-1082-444a-975c-618f9f4f1a12 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:39.110356 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4a011e6a-1082-444a-975c-618f9f4f1a12 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:39.133482 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-4a011e6a-1082-444a-975c-618f9f4f1a12 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39/ips" status: 200 len: 150 microversion: 2.1 time: 0.038506 Aug 04 21:53:39.134054 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 508/1020] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 4 21:53:39 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:53:40.833210 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:53:40.834091 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:53:40.838165 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-45950e22-adfd-4ba3-abf5-d6ddf3cfca0d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ecb0fca-a2a9-4dc6-883b-cf87f407b809"}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:53:40.840502 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-45950e22-adfd-4ba3-abf5-d6ddf3cfca0d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:40.846814 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-45950e22-adfd-4ba3-abf5-d6ddf3cfca0d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:40.847297 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-45950e22-adfd-4ba3-abf5-d6ddf3cfca0d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:40.847806 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-45950e22-adfd-4ba3-abf5-d6ddf3cfca0d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:40.849142 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-45950e22-adfd-4ba3-abf5-d6ddf3cfca0d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:40.849548 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-45950e22-adfd-4ba3-abf5-d6ddf3cfca0d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:40.849972 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-45950e22-adfd-4ba3-abf5-d6ddf3cfca0d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:41.752149 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-45950e22-adfd-4ba3-abf5-d6ddf3cfca0d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "POST /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.920584 Aug 04 21:53:41.752936 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 513/1021] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 4 21:53:40 2022] POST /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39/os-volume_attachments => generated 194 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:53:47.519730 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:53:47.520321 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Thu Aug 4 21:53:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:53:49.295376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2e7a361f-f005-4928-820b-549e07e8b684 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Action: 'create', calling method: .version_select at 0x7f3c107caee0>, body: {"keypair": {"name": "tempest-keypair-488003268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIydMc/x+x69VXqNDjnTMR1lfSECEZeyLbWmylTrUXwNETw0Wo7fChxAWoYSIjN+kHwvox3YOnas5or25K+dr68jsyIRgs7OUg6bipISb91XkJW8xRcEAWGw3So0U0LYhw=="}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:53:49.312861 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-2e7a361f-f005-4928-820b-549e07e8b684 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Getting quotas for project 8c4ab3c7309249228e42c226277fb14f. Resources: {'key_pairs'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:53:49.316917 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-2e7a361f-f005-4928-820b-549e07e8b684 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Getting quotas for user a022ce50f3334e919dcf0008bb6afcf8 and project 8c4ab3c7309249228e42c226277fb14f. Resources: {'key_pairs'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:53:49.440286 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2e7a361f-f005-4928-820b-549e07e8b684 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.149775 Aug 04 21:53:49.440960 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 509/1022] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 4 21:53:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:53:51.697366 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-7365f6d5-b32a-45e6-9bf9-b498cf5f5f2e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2108399034", "imageRef": "fca0c9ba-fb0a-4f30-932f-84d5253674ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7a01edd-380d-4680-81ec-9f1437601985"}], "security_groups": [{"name": "tempest-securitygroup--1627864247"}], "key_name": "tempest-keypair-488003268", "user_data": "}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:53:51.706680 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=2 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:53:51.707339 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:53:51.807245 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.network.neutron [None req-7365f6d5-b32a-45e6-9bf9-b498cf5f5f2e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] validate_networks() for [('f7a01edd-380d-4680-81ec-9f1437601985', None, None, None, None, None)] {{(pid=136342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:53:52.280962 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-7365f6d5-b32a-45e6-9bf9-b498cf5f5f2e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Flavor limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:53:52.281381 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-7365f6d5-b32a-45e6-9bf9-b498cf5f5f2e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Image limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:53:52.281851 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-7365f6d5-b32a-45e6-9bf9-b498cf5f5f2e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Flavor pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:53:52.282336 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-7365f6d5-b32a-45e6-9bf9-b498cf5f5f2e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Image pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:53:52.282745 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-7365f6d5-b32a-45e6-9bf9-b498cf5f5f2e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:53:52.291479 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7365f6d5-b32a-45e6-9bf9-b498cf5f5f2e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:52.291958 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7365f6d5-b32a-45e6-9bf9-b498cf5f5f2e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:52.292389 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7365f6d5-b32a-45e6-9bf9-b498cf5f5f2e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:52.293122 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7365f6d5-b32a-45e6-9bf9-b498cf5f5f2e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:52.294200 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7365f6d5-b32a-45e6-9bf9-b498cf5f5f2e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:52.294622 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7365f6d5-b32a-45e6-9bf9-b498cf5f5f2e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:52.311932 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-7365f6d5-b32a-45e6-9bf9-b498cf5f5f2e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Getting quotas for project 8c4ab3c7309249228e42c226277fb14f. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:53:52.315994 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-7365f6d5-b32a-45e6-9bf9-b498cf5f5f2e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Getting quotas for user a022ce50f3334e919dcf0008bb6afcf8 and project 8c4ab3c7309249228e42c226277fb14f. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:53:52.326918 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7365f6d5-b32a-45e6-9bf9-b498cf5f5f2e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Going to run 1 instances... {{(pid=136342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:53:52.329250 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7365f6d5-b32a-45e6-9bf9-b498cf5f5f2e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca0c9ba-fb0a-4f30-932f-84d5253674ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:53:52.474431 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-7365f6d5-b32a-45e6-9bf9-b498cf5f5f2e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.781678 Aug 04 21:53:52.475083 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 514/1023] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 4 21:53:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:53:52.486933 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-36967fbc-822e-47f3-b44f-dd449cf66cb7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:52.487597 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-36967fbc-822e-47f3-b44f-dd449cf66cb7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:52.545414 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-36967fbc-822e-47f3-b44f-dd449cf66cb7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:53:52.552092 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-36967fbc-822e-47f3-b44f-dd449cf66cb7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10" status: 200 len: 1241 microversion: 2.1 time: 0.069641 Aug 04 21:53:52.552654 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 510/1024] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:53:52 2022] GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:53:53.573526 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-0199a392-8267-4a10-b475-59ace79c5627 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:53.574305 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-0199a392-8267-4a10-b475-59ace79c5627 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:53.582291 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0199a392-8267-4a10-b475-59ace79c5627 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:53.584097 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0199a392-8267-4a10-b475-59ace79c5627 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:53.584097 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0199a392-8267-4a10-b475-59ace79c5627 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:53.584097 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0199a392-8267-4a10-b475-59ace79c5627 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:53.584459 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0199a392-8267-4a10-b475-59ace79c5627 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:53.584825 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0199a392-8267-4a10-b475-59ace79c5627 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:53.652506 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0199a392-8267-4a10-b475-59ace79c5627 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:53:53.660265 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-0199a392-8267-4a10-b475-59ace79c5627 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10" status: 200 len: 1245 microversion: 2.1 time: 0.091191 Aug 04 21:53:53.660811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 515/1025] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:53:53 2022] GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:53:54.682185 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-8cc33b6d-4ff9-4992-b827-d2abeab30928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:54.682818 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-8cc33b6d-4ff9-4992-b827-d2abeab30928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:54.689250 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8cc33b6d-4ff9-4992-b827-d2abeab30928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:54.689729 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8cc33b6d-4ff9-4992-b827-d2abeab30928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:54.690195 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8cc33b6d-4ff9-4992-b827-d2abeab30928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:54.690905 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8cc33b6d-4ff9-4992-b827-d2abeab30928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:54.691460 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8cc33b6d-4ff9-4992-b827-d2abeab30928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:54.692002 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8cc33b6d-4ff9-4992-b827-d2abeab30928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:54.761481 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8cc33b6d-4ff9-4992-b827-d2abeab30928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:53:54.771537 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-8cc33b6d-4ff9-4992-b827-d2abeab30928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10" status: 200 len: 1301 microversion: 2.1 time: 0.093202 Aug 04 21:53:54.772141 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 511/1026] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:53:54 2022] GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 => generated 1301 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:53:55.792770 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-c13c8bc0-702f-4457-9b8d-30a10e5643be tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:55.793881 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-c13c8bc0-702f-4457-9b8d-30a10e5643be tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:55.800364 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c13c8bc0-702f-4457-9b8d-30a10e5643be tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:55.800836 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c13c8bc0-702f-4457-9b8d-30a10e5643be tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:55.801266 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c13c8bc0-702f-4457-9b8d-30a10e5643be tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:55.801962 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c13c8bc0-702f-4457-9b8d-30a10e5643be tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:55.802457 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c13c8bc0-702f-4457-9b8d-30a10e5643be tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:55.802857 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c13c8bc0-702f-4457-9b8d-30a10e5643be tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:55.971294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-c13c8bc0-702f-4457-9b8d-30a10e5643be tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:53:55.978781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-c13c8bc0-702f-4457-9b8d-30a10e5643be tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10" status: 200 len: 1367 microversion: 2.1 time: 0.189987 Aug 04 21:53:55.979400 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 516/1027] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:53:55 2022] GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:53:56.295427 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-f419528b-c50a-45aa-816b-ec8e315ae632 req-66976800-2ef4-4e53-b9fd-94f4f21ee739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14c3d2d2-5c7d-4f15-80c9-7cdc84595f10", "tag": "97b6ca7e-e150-4adb-a2cf-f1d20f2820a8"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:53:56.305452 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-f419528b-c50a-45aa-816b-ec8e315ae632 req-66976800-2ef4-4e53-b9fd-94f4f21ee739 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:56.305900 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-f419528b-c50a-45aa-816b-ec8e315ae632 req-66976800-2ef4-4e53-b9fd-94f4f21ee739 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:56.306362 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-f419528b-c50a-45aa-816b-ec8e315ae632 req-66976800-2ef4-4e53-b9fd-94f4f21ee739 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:56.319831 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-f419528b-c50a-45aa-816b-ec8e315ae632 req-66976800-2ef4-4e53-b9fd-94f4f21ee739 service nova] Creating event network-changed:97b6ca7e-e150-4adb-a2cf-f1d20f2820a8 for instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 on hv-cinder-85220 Aug 04 21:53:56.324628 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-f419528b-c50a-45aa-816b-ec8e315ae632 req-66976800-2ef4-4e53-b9fd-94f4f21ee739 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033291 Aug 04 21:53:56.326587 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 512/1028] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:53:57.000333 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-177d88a0-f150-4093-9336-0e9478daea98 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:57.000959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-177d88a0-f150-4093-9336-0e9478daea98 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:57.008226 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-177d88a0-f150-4093-9336-0e9478daea98 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:57.008721 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-177d88a0-f150-4093-9336-0e9478daea98 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:57.009149 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-177d88a0-f150-4093-9336-0e9478daea98 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:57.009852 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-177d88a0-f150-4093-9336-0e9478daea98 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:57.010331 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-177d88a0-f150-4093-9336-0e9478daea98 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:57.010749 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-177d88a0-f150-4093-9336-0e9478daea98 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:57.365101 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-177d88a0-f150-4093-9336-0e9478daea98 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:53:57.374061 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-177d88a0-f150-4093-9336-0e9478daea98 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10" status: 200 len: 1367 microversion: 2.1 time: 0.378429 Aug 04 21:53:57.374649 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 517/1029] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:53:56 2022] GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 => generated 1367 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:53:58.395947 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-71e5cfab-e9ed-419f-9511-da42a624f877 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:58.396638 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-71e5cfab-e9ed-419f-9511-da42a624f877 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:58.402923 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-71e5cfab-e9ed-419f-9511-da42a624f877 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:58.403999 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-71e5cfab-e9ed-419f-9511-da42a624f877 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:58.404542 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-71e5cfab-e9ed-419f-9511-da42a624f877 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:58.405224 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-71e5cfab-e9ed-419f-9511-da42a624f877 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:58.405666 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-71e5cfab-e9ed-419f-9511-da42a624f877 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:58.406231 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-71e5cfab-e9ed-419f-9511-da42a624f877 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:58.540547 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-71e5cfab-e9ed-419f-9511-da42a624f877 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:53:58.548572 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-71e5cfab-e9ed-419f-9511-da42a624f877 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10" status: 200 len: 1367 microversion: 2.1 time: 0.157453 Aug 04 21:53:58.549127 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 513/1030] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:53:58 2022] GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:53:59.568782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-cd804aff-1fa9-407f-bbe2-b62a0169633f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:53:59.569372 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-cd804aff-1fa9-407f-bbe2-b62a0169633f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:53:59.575888 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cd804aff-1fa9-407f-bbe2-b62a0169633f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:59.576363 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cd804aff-1fa9-407f-bbe2-b62a0169633f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:59.576793 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cd804aff-1fa9-407f-bbe2-b62a0169633f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:59.577483 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cd804aff-1fa9-407f-bbe2-b62a0169633f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:53:59.577926 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cd804aff-1fa9-407f-bbe2-b62a0169633f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:53:59.578372 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cd804aff-1fa9-407f-bbe2-b62a0169633f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:53:59.713406 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-cd804aff-1fa9-407f-bbe2-b62a0169633f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:53:59.721877 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-cd804aff-1fa9-407f-bbe2-b62a0169633f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10" status: 200 len: 1367 microversion: 2.1 time: 0.157003 Aug 04 21:53:59.722470 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 518/1031] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:53:59 2022] GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:54:00.742845 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-6e7f6e46-ead0-4035-a1c6-a31004f9179d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:54:00.743442 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-6e7f6e46-ead0-4035-a1c6-a31004f9179d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:54:00.757517 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e7f6e46-ead0-4035-a1c6-a31004f9179d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:54:00.758034 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e7f6e46-ead0-4035-a1c6-a31004f9179d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:54:00.758472 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e7f6e46-ead0-4035-a1c6-a31004f9179d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:54:00.759164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e7f6e46-ead0-4035-a1c6-a31004f9179d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:54:00.759616 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e7f6e46-ead0-4035-a1c6-a31004f9179d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:54:00.760036 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6e7f6e46-ead0-4035-a1c6-a31004f9179d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:54:00.895168 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6e7f6e46-ead0-4035-a1c6-a31004f9179d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:54:00.903011 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-6e7f6e46-ead0-4035-a1c6-a31004f9179d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10" status: 200 len: 1367 microversion: 2.1 time: 0.163953 Aug 04 21:54:00.904173 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 514/1032] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:54:00 2022] GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:54:01.925258 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-71e66247-fea8-4255-8227-a2e227dfe92d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:54:01.925918 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-71e66247-fea8-4255-8227-a2e227dfe92d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:54:01.932321 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-71e66247-fea8-4255-8227-a2e227dfe92d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:54:01.932830 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-71e66247-fea8-4255-8227-a2e227dfe92d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:54:01.933261 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-71e66247-fea8-4255-8227-a2e227dfe92d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:54:01.933948 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-71e66247-fea8-4255-8227-a2e227dfe92d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:54:01.934437 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-71e66247-fea8-4255-8227-a2e227dfe92d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:54:01.935716 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-71e66247-fea8-4255-8227-a2e227dfe92d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:54:02.072068 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-71e66247-fea8-4255-8227-a2e227dfe92d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:54:02.079633 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-71e66247-fea8-4255-8227-a2e227dfe92d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10" status: 200 len: 1367 microversion: 2.1 time: 0.158280 Aug 04 21:54:02.080197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 519/1033] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:54:01 2022] GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:54:03.100781 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ced2929a-ced1-443a-bfb4-f7314c3e5202 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:54:03.101408 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ced2929a-ced1-443a-bfb4-f7314c3e5202 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:54:03.103840 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=6 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:54:03.108769 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ced2929a-ced1-443a-bfb4-f7314c3e5202 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:54:03.109241 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ced2929a-ced1-443a-bfb4-f7314c3e5202 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:54:03.109672 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ced2929a-ced1-443a-bfb4-f7314c3e5202 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:54:03.110396 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ced2929a-ced1-443a-bfb4-f7314c3e5202 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:54:03.110842 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ced2929a-ced1-443a-bfb4-f7314c3e5202 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:54:03.111255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ced2929a-ced1-443a-bfb4-f7314c3e5202 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:54:03.245270 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ced2929a-ced1-443a-bfb4-f7314c3e5202 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:54:03.253600 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ced2929a-ced1-443a-bfb4-f7314c3e5202 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10" status: 200 len: 1367 microversion: 2.1 time: 0.156780 Aug 04 21:54:03.254186 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 515/1034] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:54:03 2022] GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:54:03.762891 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-7f81330e-d2bd-4c35-abb7-91a7b5629d64 req-5c976154-eeeb-489b-8522-17d5b823ff96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14c3d2d2-5c7d-4f15-80c9-7cdc84595f10", "name": "network-vif-plugged", "status": "completed", "tag": "97b6ca7e-e150-4adb-a2cf-f1d20f2820a8"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:54:03.768494 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=2 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:54:03.769162 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=6 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:54:03.774775 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-7f81330e-d2bd-4c35-abb7-91a7b5629d64 req-5c976154-eeeb-489b-8522-17d5b823ff96 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:54:03.775256 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-7f81330e-d2bd-4c35-abb7-91a7b5629d64 req-5c976154-eeeb-489b-8522-17d5b823ff96 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:54:03.775691 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-7f81330e-d2bd-4c35-abb7-91a7b5629d64 req-5c976154-eeeb-489b-8522-17d5b823ff96 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:54:03.786836 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-7f81330e-d2bd-4c35-abb7-91a7b5629d64 req-5c976154-eeeb-489b-8522-17d5b823ff96 service nova] Creating event network-vif-plugged:97b6ca7e-e150-4adb-a2cf-f1d20f2820a8 for instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 on hv-cinder-85220 Aug 04 21:54:03.792117 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-7f81330e-d2bd-4c35-abb7-91a7b5629d64 req-5c976154-eeeb-489b-8522-17d5b823ff96 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033029 Aug 04 21:54:03.794162 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 520/1035] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:54:04.274858 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-eebe4f48-0850-4d8d-b332-891ae84e6ce6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:54:04.275583 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-eebe4f48-0850-4d8d-b332-891ae84e6ce6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:54:04.283252 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-eebe4f48-0850-4d8d-b332-891ae84e6ce6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:54:04.283737 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-eebe4f48-0850-4d8d-b332-891ae84e6ce6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:54:04.284172 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-eebe4f48-0850-4d8d-b332-891ae84e6ce6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:54:04.284861 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-eebe4f48-0850-4d8d-b332-891ae84e6ce6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:54:04.285309 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-eebe4f48-0850-4d8d-b332-891ae84e6ce6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:54:04.285759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-eebe4f48-0850-4d8d-b332-891ae84e6ce6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:54:04.414701 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-eebe4f48-0850-4d8d-b332-891ae84e6ce6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:54:04.422955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-eebe4f48-0850-4d8d-b332-891ae84e6ce6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10" status: 200 len: 1367 microversion: 2.1 time: 0.152049 Aug 04 21:54:04.423521 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 516/1036] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:54:04 2022] GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:54:05.445514 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-7702de2b-8db7-44ba-8682-df7aac993b24 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:54:05.446345 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7702de2b-8db7-44ba-8682-df7aac993b24 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:54:05.454511 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7702de2b-8db7-44ba-8682-df7aac993b24 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:54:05.455003 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7702de2b-8db7-44ba-8682-df7aac993b24 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:54:05.455449 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7702de2b-8db7-44ba-8682-df7aac993b24 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:54:05.456148 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7702de2b-8db7-44ba-8682-df7aac993b24 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:54:05.456602 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7702de2b-8db7-44ba-8682-df7aac993b24 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:54:05.457026 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7702de2b-8db7-44ba-8682-df7aac993b24 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:54:05.596498 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7702de2b-8db7-44ba-8682-df7aac993b24 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:54:05.604652 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-7702de2b-8db7-44ba-8682-df7aac993b24 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10" status: 200 len: 1367 microversion: 2.1 time: 0.164075 Aug 04 21:54:05.605293 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 521/1037] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:54:05 2022] GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:54:06.626847 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c8a37729-13ae-48e9-bd04-a1921b28c06a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:54:06.627440 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c8a37729-13ae-48e9-bd04-a1921b28c06a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:54:06.633792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c8a37729-13ae-48e9-bd04-a1921b28c06a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:54:06.634310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c8a37729-13ae-48e9-bd04-a1921b28c06a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:54:06.634740 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c8a37729-13ae-48e9-bd04-a1921b28c06a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:54:06.635412 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c8a37729-13ae-48e9-bd04-a1921b28c06a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:54:06.635876 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c8a37729-13ae-48e9-bd04-a1921b28c06a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:54:06.636290 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c8a37729-13ae-48e9-bd04-a1921b28c06a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:54:06.767349 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-c8a37729-13ae-48e9-bd04-a1921b28c06a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:54:06.781200 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c8a37729-13ae-48e9-bd04-a1921b28c06a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10" status: 200 len: 1556 microversion: 2.1 time: 0.152303 Aug 04 21:54:06.781200 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 517/1038] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:54:06 2022] GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:54:06.795428 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ef3995f7-83e3-4ce7-801a-26a05ac8a3fd tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:54:06.796896 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ef3995f7-83e3-4ce7-801a-26a05ac8a3fd tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:54:06.802898 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef3995f7-83e3-4ce7-801a-26a05ac8a3fd tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:54:06.803389 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef3995f7-83e3-4ce7-801a-26a05ac8a3fd tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:54:06.803822 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef3995f7-83e3-4ce7-801a-26a05ac8a3fd tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:54:06.804518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef3995f7-83e3-4ce7-801a-26a05ac8a3fd tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:54:06.804973 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef3995f7-83e3-4ce7-801a-26a05ac8a3fd tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:54:06.805395 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef3995f7-83e3-4ce7-801a-26a05ac8a3fd tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:54:06.883383 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ef3995f7-83e3-4ce7-801a-26a05ac8a3fd tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091790 Aug 04 21:54:06.883971 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 522/1039] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 4 21:54:06 2022] GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:54:07.866220 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-c78366ce-2f48-46e9-b447-21d4ff083b5a req-a04bc26f-f2e3-4724-888e-161ceba2b975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14c3d2d2-5c7d-4f15-80c9-7cdc84595f10", "tag": "97b6ca7e-e150-4adb-a2cf-f1d20f2820a8"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:54:07.876892 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-c78366ce-2f48-46e9-b447-21d4ff083b5a req-a04bc26f-f2e3-4724-888e-161ceba2b975 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:54:07.877362 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-c78366ce-2f48-46e9-b447-21d4ff083b5a req-a04bc26f-f2e3-4724-888e-161ceba2b975 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:54:07.877780 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-c78366ce-2f48-46e9-b447-21d4ff083b5a req-a04bc26f-f2e3-4724-888e-161ceba2b975 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:54:07.888727 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-c78366ce-2f48-46e9-b447-21d4ff083b5a req-a04bc26f-f2e3-4724-888e-161ceba2b975 service nova] Creating event network-changed:97b6ca7e-e150-4adb-a2cf-f1d20f2820a8 for instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 on hv-cinder-85220 Aug 04 21:54:07.893778 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-c78366ce-2f48-46e9-b447-21d4ff083b5a req-a04bc26f-f2e3-4724-888e-161ceba2b975 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031307 Aug 04 21:54:07.894732 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 518/1040] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:55:22.670273 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:55:22.671125 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=44 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:55:22.675404 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6db000cc-6d1d-45be-a615-9f613839bfa1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:55:22.675937 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-6db000cc-6d1d-45be-a615-9f613839bfa1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:22.681930 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6db000cc-6d1d-45be-a615-9f613839bfa1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:22.691487 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6db000cc-6d1d-45be-a615-9f613839bfa1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:22.691487 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6db000cc-6d1d-45be-a615-9f613839bfa1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:22.691487 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6db000cc-6d1d-45be-a615-9f613839bfa1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:22.691487 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6db000cc-6d1d-45be-a615-9f613839bfa1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:22.692079 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6db000cc-6d1d-45be-a615-9f613839bfa1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:22.707890 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-6db000cc-6d1d-45be-a615-9f613839bfa1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lazy-loading 'flavor' on Instance uuid 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:55:22.847479 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:55:22.848231 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=44 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:55:22.852652 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-cc788cdc-b325-4e5c-8ba7-4ea167a51f33 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:22.853232 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-cc788cdc-b325-4e5c-8ba7-4ea167a51f33 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:22.861902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cc788cdc-b325-4e5c-8ba7-4ea167a51f33 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:22.863029 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cc788cdc-b325-4e5c-8ba7-4ea167a51f33 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:22.863029 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cc788cdc-b325-4e5c-8ba7-4ea167a51f33 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:22.863582 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cc788cdc-b325-4e5c-8ba7-4ea167a51f33 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:22.864030 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cc788cdc-b325-4e5c-8ba7-4ea167a51f33 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:22.864449 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cc788cdc-b325-4e5c-8ba7-4ea167a51f33 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:22.891364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-cc788cdc-b325-4e5c-8ba7-4ea167a51f33 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10/ips" status: 200 len: 148 microversion: 2.1 time: 0.046122 Aug 04 21:55:22.891951 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 519/1041] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 4 21:55:22 2022] GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10/ips => generated 148 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:55:22.904735 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e6c1db5e-aff0-4cd9-ab02-5a123e78794a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ecb0fca-a2a9-4dc6-883b-cf87f407b809"}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:55:22.907121 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e6c1db5e-aff0-4cd9-ab02-5a123e78794a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:22.913029 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e6c1db5e-aff0-4cd9-ab02-5a123e78794a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:22.913511 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e6c1db5e-aff0-4cd9-ab02-5a123e78794a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:22.913943 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e6c1db5e-aff0-4cd9-ab02-5a123e78794a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:22.914671 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e6c1db5e-aff0-4cd9-ab02-5a123e78794a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:22.915120 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e6c1db5e-aff0-4cd9-ab02-5a123e78794a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:22.915539 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e6c1db5e-aff0-4cd9-ab02-5a123e78794a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:22.982501 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-6db000cc-6d1d-45be-a615-9f613839bfa1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "POST /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd/action" status: 202 len: 0 microversion: 2.1 time: 0.314070 Aug 04 21:55:22.983098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 523/1042] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 4 21:55:22 2022] POST /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:55:22.993235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-0c9e4dd5-7dd5-47f5-bb69-9078bc057882 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:22.993988 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-0c9e4dd5-7dd5-47f5-bb69-9078bc057882 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:23.001253 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0c9e4dd5-7dd5-47f5-bb69-9078bc057882 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:23.001742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0c9e4dd5-7dd5-47f5-bb69-9078bc057882 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:23.002307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0c9e4dd5-7dd5-47f5-bb69-9078bc057882 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:23.003007 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0c9e4dd5-7dd5-47f5-bb69-9078bc057882 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:23.003457 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0c9e4dd5-7dd5-47f5-bb69-9078bc057882 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:23.004131 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0c9e4dd5-7dd5-47f5-bb69-9078bc057882 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:23.194263 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-e6c1db5e-aff0-4cd9-ab02-5a123e78794a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] HTTP exception thrown: Invalid volume: volume 7ecb0fca-a2a9-4dc6-883b-cf87f407b809 is already attached to instances: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 Aug 04 21:55:23.196266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e6c1db5e-aff0-4cd9-ab02-5a123e78794a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Request method failure captured: Aug 04 21:55:23.196266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: POST /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10/os-volume_attachments HTTP/1.1 Aug 04 21:55:23.196266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:55:23.196266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:55:23.196266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:55:23.196266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 74 Aug 04 21:55:23.196266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:55:23.196266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:55:23.196266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:55:23.196266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:55:23.196266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7D9t8rsKG84MG-XeY6Nlc6oGUGTGzOn1qsEfIgp1-xWWIq9149YutAj8rytKzxl4OvY1D-ym8-Nqng1af7gQx4CCQV_83zm6k1TU_HYRQtFUyhCDmnq8eGjcIc6yEaD-_4bsQnyh21Y-tgkQxsJlI6-_LY5y9tnue57bh7Fq5uafa0U Aug 04 21:55:23.196266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:55:23.196266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:55:23.196266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:55:23.196266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:55:23.196266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:55:23.196266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:55:23.196266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:55:23.196266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:55:23.196266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:55:23.196266 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:55:23.197935 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8c4ab3c7309249228e42c226277fb14f", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:55:23.197935 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:55:23.197935 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:55:23.197935 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:55:23.197935 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:55:23.197935 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:55:23.197935 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:55:23.197935 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: a022ce50f3334e919dcf0008bb6afcf8 Aug 04 21:55:23.197935 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:55:23.197935 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Aug 04 21:55:23.197935 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {"volumeAttachment": {"volumeId": "7ecb0fca-a2a9-4dc6-883b-cf87f407b809"}} Aug 04 21:55:23.197935 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 21:55:23.199074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Invalid volume: volume 7ecb0fca-a2a9-4dc6-883b-cf87f407b809 is already attached to instances: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 Aug 04 21:55:23.199074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'server_id': '14c3d2d2-5c7d-4f15-80c9-7cdc84595f10', 'body': {'volumeAttachment': {'volumeId': '7ecb0fca-a2a9-4dc6-883b-cf87f407b809'}}} Aug 04 21:55:23.199074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:55:23.199074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:55:23.199074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 21:55:23.199074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 21:55:23.199074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 21:55:23.199074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 21:55:23.199074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 21:55:23.199074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 21:55:23.199074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 21:55:23.199074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 21:55:23.199074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 21:55:23.199074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 21:55:23.199074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7ecb0fca-a2a9-4dc6-883b-cf87f407b809 is already attached to instances: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 Aug 04 21:55:23.199074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:55:23.199074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:55:23.199074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:55:23.199074 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:55:23.201301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:55:23.201301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:55:23.201301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:55:23.201301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:55:23.201301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:55:23.201301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:55:23.201301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:55:23.201301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:55:23.201301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:55:23.201301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:55:23.201301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:55:23.201301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:55:23.201301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 21:55:23.201301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 21:55:23.201301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7ecb0fca-a2a9-4dc6-883b-cf87f407b809 is already attached to instances: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 Aug 04 21:55:23.201301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:55:23.201301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:55:23.201301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:55:23.201301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:55:23.201301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:55:23.203146 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:55:23.203146 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:55:23.203146 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:55:23.203146 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7ecb0fca-a2a9-4dc6-883b-cf87f407b809 is already attached to instances: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 Aug 04 21:55:23.203146 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:55:23.203146 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e6c1db5e-aff0-4cd9-ab02-5a123e78794a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Returning 400 to user: Invalid volume: volume 7ecb0fca-a2a9-4dc6-883b-cf87f407b809 is already attached to instances: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:55:23.203146 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e6c1db5e-aff0-4cd9-ab02-5a123e78794a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "POST /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.297604 Aug 04 21:55:23.203146 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 520/1043] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 4 21:55:22 2022] POST /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10/os-volume_attachments => generated 174 bytes in 299 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 21:55:23.211255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e1333284-1635-4198-958c-ff2d6d1f8a12 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:23.211748 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e1333284-1635-4198-958c-ff2d6d1f8a12 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:23.218675 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e1333284-1635-4198-958c-ff2d6d1f8a12 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:23.219179 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e1333284-1635-4198-958c-ff2d6d1f8a12 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:23.219618 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e1333284-1635-4198-958c-ff2d6d1f8a12 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:23.220327 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e1333284-1635-4198-958c-ff2d6d1f8a12 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:23.220778 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e1333284-1635-4198-958c-ff2d6d1f8a12 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:23.221195 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e1333284-1635-4198-958c-ff2d6d1f8a12 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:23.248363 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e1333284-1635-4198-958c-ff2d6d1f8a12 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Going to try to terminate instance {{(pid=136341) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:55:23.296849 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0c9e4dd5-7dd5-47f5-bb69-9078bc057882 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:23.304743 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-0c9e4dd5-7dd5-47f5-bb69-9078bc057882 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1570 microversion: 2.1 time: 0.315775 Aug 04 21:55:23.305308 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 524/1044] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:22 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1570 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:55:23.498224 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e1333284-1635-4198-958c-ff2d6d1f8a12 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "DELETE /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10" status: 204 len: 0 microversion: 2.1 time: 0.290392 Aug 04 21:55:23.498807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 521/1045] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:55:23 2022] DELETE /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:55:23.507209 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-adb8f633-f77b-4f11-a9bf-dbfb70648faf tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:23.507911 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-adb8f633-f77b-4f11-a9bf-dbfb70648faf tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:23.514874 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-adb8f633-f77b-4f11-a9bf-dbfb70648faf tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:23.515359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-adb8f633-f77b-4f11-a9bf-dbfb70648faf tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:23.515792 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-adb8f633-f77b-4f11-a9bf-dbfb70648faf tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:23.516489 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-adb8f633-f77b-4f11-a9bf-dbfb70648faf tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:23.516942 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-adb8f633-f77b-4f11-a9bf-dbfb70648faf tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:23.517402 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-adb8f633-f77b-4f11-a9bf-dbfb70648faf tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:23.655784 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-adb8f633-f77b-4f11-a9bf-dbfb70648faf tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:23.663464 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-adb8f633-f77b-4f11-a9bf-dbfb70648faf tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10" status: 200 len: 1680 microversion: 2.1 time: 0.160160 Aug 04 21:55:23.664020 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 525/1046] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:23 2022] GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:24.327164 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c4b64e90-2a7c-4e37-8c46-3fdfe4336cdc tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:24.327865 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c4b64e90-2a7c-4e37-8c46-3fdfe4336cdc tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:24.335036 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c4b64e90-2a7c-4e37-8c46-3fdfe4336cdc tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:24.335527 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c4b64e90-2a7c-4e37-8c46-3fdfe4336cdc tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:24.335965 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c4b64e90-2a7c-4e37-8c46-3fdfe4336cdc tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:24.336662 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c4b64e90-2a7c-4e37-8c46-3fdfe4336cdc tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:24.337111 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c4b64e90-2a7c-4e37-8c46-3fdfe4336cdc tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:24.337532 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c4b64e90-2a7c-4e37-8c46-3fdfe4336cdc tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:24.475624 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-c4b64e90-2a7c-4e37-8c46-3fdfe4336cdc tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:24.483381 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c4b64e90-2a7c-4e37-8c46-3fdfe4336cdc tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1570 microversion: 2.1 time: 0.161107 Aug 04 21:55:24.483944 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 522/1047] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:24 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:24.685626 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-9f962f84-c658-4a9f-89a2-daf523350b36 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:24.686449 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-9f962f84-c658-4a9f-89a2-daf523350b36 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:24.697064 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9f962f84-c658-4a9f-89a2-daf523350b36 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:24.697545 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9f962f84-c658-4a9f-89a2-daf523350b36 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:24.697974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9f962f84-c658-4a9f-89a2-daf523350b36 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:24.698690 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9f962f84-c658-4a9f-89a2-daf523350b36 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:24.699138 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9f962f84-c658-4a9f-89a2-daf523350b36 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:24.699557 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9f962f84-c658-4a9f-89a2-daf523350b36 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:24.835740 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-9f962f84-c658-4a9f-89a2-daf523350b36 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:24.844324 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-9f962f84-c658-4a9f-89a2-daf523350b36 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10" status: 200 len: 1680 microversion: 2.1 time: 0.162594 Aug 04 21:55:24.847592 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 526/1048] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:24 2022] GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:25.505443 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-154305c4-2b4b-467b-a9ef-3320ccfee32b tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:25.506099 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-154305c4-2b4b-467b-a9ef-3320ccfee32b tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:25.512697 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-154305c4-2b4b-467b-a9ef-3320ccfee32b tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:25.513188 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-154305c4-2b4b-467b-a9ef-3320ccfee32b tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:25.513624 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-154305c4-2b4b-467b-a9ef-3320ccfee32b tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:25.514376 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-154305c4-2b4b-467b-a9ef-3320ccfee32b tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:25.514828 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-154305c4-2b4b-467b-a9ef-3320ccfee32b tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:25.515250 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-154305c4-2b4b-467b-a9ef-3320ccfee32b tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:25.670650 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-154305c4-2b4b-467b-a9ef-3320ccfee32b tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:25.678658 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-154305c4-2b4b-467b-a9ef-3320ccfee32b tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1570 microversion: 2.1 time: 0.177066 Aug 04 21:55:25.679440 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 523/1049] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:25 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:25.867647 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6d12a6d7-1f83-4d41-bdc7-635275850954 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:25.868296 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-6d12a6d7-1f83-4d41-bdc7-635275850954 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:25.877047 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6d12a6d7-1f83-4d41-bdc7-635275850954 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:25.883409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6d12a6d7-1f83-4d41-bdc7-635275850954 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:25.883409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6d12a6d7-1f83-4d41-bdc7-635275850954 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:25.883409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6d12a6d7-1f83-4d41-bdc7-635275850954 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:25.883409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6d12a6d7-1f83-4d41-bdc7-635275850954 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:25.884059 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6d12a6d7-1f83-4d41-bdc7-635275850954 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:26.079471 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-6d12a6d7-1f83-4d41-bdc7-635275850954 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:26.087633 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-6d12a6d7-1f83-4d41-bdc7-635275850954 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10" status: 200 len: 1680 microversion: 2.1 time: 0.223886 Aug 04 21:55:26.088188 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 527/1050] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:25 2022] GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 => generated 1680 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:26.466614 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-d6f8be5d-7052-4dbe-a03d-8b8043496c93 req-bf112d1c-3fc6-4225-9d8d-1aa821a85f9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14c3d2d2-5c7d-4f15-80c9-7cdc84595f10", "name": "network-vif-deleted", "tag": "97b6ca7e-e150-4adb-a2cf-f1d20f2820a8"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:55:26.476688 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-d6f8be5d-7052-4dbe-a03d-8b8043496c93 req-bf112d1c-3fc6-4225-9d8d-1aa821a85f9b service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:26.477168 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-d6f8be5d-7052-4dbe-a03d-8b8043496c93 req-bf112d1c-3fc6-4225-9d8d-1aa821a85f9b service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:26.477594 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-d6f8be5d-7052-4dbe-a03d-8b8043496c93 req-bf112d1c-3fc6-4225-9d8d-1aa821a85f9b service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:26.490397 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-d6f8be5d-7052-4dbe-a03d-8b8043496c93 req-bf112d1c-3fc6-4225-9d8d-1aa821a85f9b service nova] Creating event network-vif-deleted:97b6ca7e-e150-4adb-a2cf-f1d20f2820a8 for instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 on hv-cinder-85220 Aug 04 21:55:26.497983 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-d6f8be5d-7052-4dbe-a03d-8b8043496c93 req-bf112d1c-3fc6-4225-9d8d-1aa821a85f9b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036644 Aug 04 21:55:26.499051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 524/1051] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:55:26.712964 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-bad5224f-46d6-432c-8119-7b1058387abb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:26.713690 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-bad5224f-46d6-432c-8119-7b1058387abb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:26.721192 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bad5224f-46d6-432c-8119-7b1058387abb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:26.721797 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bad5224f-46d6-432c-8119-7b1058387abb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:26.722328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bad5224f-46d6-432c-8119-7b1058387abb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:26.723109 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bad5224f-46d6-432c-8119-7b1058387abb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:26.723632 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bad5224f-46d6-432c-8119-7b1058387abb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:26.724146 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bad5224f-46d6-432c-8119-7b1058387abb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:26.877349 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-bad5224f-46d6-432c-8119-7b1058387abb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:26.885631 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-bad5224f-46d6-432c-8119-7b1058387abb tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1570 microversion: 2.1 time: 0.176716 Aug 04 21:55:26.886219 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 528/1052] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:26 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:27.110819 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-0b562839-8702-4bc9-a410-3407208f1d1d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:27.111628 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-0b562839-8702-4bc9-a410-3407208f1d1d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:27.117727 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0b562839-8702-4bc9-a410-3407208f1d1d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:27.118253 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0b562839-8702-4bc9-a410-3407208f1d1d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:27.118692 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0b562839-8702-4bc9-a410-3407208f1d1d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:27.119387 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0b562839-8702-4bc9-a410-3407208f1d1d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:27.119831 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0b562839-8702-4bc9-a410-3407208f1d1d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:27.120243 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0b562839-8702-4bc9-a410-3407208f1d1d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:27.155511 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0b562839-8702-4bc9-a410-3407208f1d1d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:27.156161 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0b562839-8702-4bc9-a410-3407208f1d1d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:27.156602 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0b562839-8702-4bc9-a410-3407208f1d1d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:27.157063 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.objects.instance [None req-0b562839-8702-4bc9-a410-3407208f1d1d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lazy-loading 'fault' on Instance uuid 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 {{(pid=136341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:55:27.208684 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-0b562839-8702-4bc9-a410-3407208f1d1d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:27.217510 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-0b562839-8702-4bc9-a410-3407208f1d1d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10" status: 200 len: 1331 microversion: 2.1 time: 0.112229 Aug 04 21:55:27.218154 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 525/1053] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:27 2022] GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:27.907524 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-72fc383b-a872-4658-bd08-de98c96a6b56 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:27.908159 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-72fc383b-a872-4658-bd08-de98c96a6b56 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:27.914755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-72fc383b-a872-4658-bd08-de98c96a6b56 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:27.915238 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-72fc383b-a872-4658-bd08-de98c96a6b56 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:27.915663 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-72fc383b-a872-4658-bd08-de98c96a6b56 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:27.916360 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-72fc383b-a872-4658-bd08-de98c96a6b56 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:27.916805 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-72fc383b-a872-4658-bd08-de98c96a6b56 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:27.917223 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-72fc383b-a872-4658-bd08-de98c96a6b56 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:28.062973 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-72fc383b-a872-4658-bd08-de98c96a6b56 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:28.070782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-72fc383b-a872-4658-bd08-de98c96a6b56 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1570 microversion: 2.1 time: 0.167315 Aug 04 21:55:28.071342 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 529/1054] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:27 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:28.239396 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-50dae488-35e3-4cdc-bbb6-513b950835e1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:28.240013 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-50dae488-35e3-4cdc-bbb6-513b950835e1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:28.246585 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-50dae488-35e3-4cdc-bbb6-513b950835e1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:28.247113 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-50dae488-35e3-4cdc-bbb6-513b950835e1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:28.247551 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-50dae488-35e3-4cdc-bbb6-513b950835e1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:28.248502 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-50dae488-35e3-4cdc-bbb6-513b950835e1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:28.249199 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-50dae488-35e3-4cdc-bbb6-513b950835e1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:28.249422 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-50dae488-35e3-4cdc-bbb6-513b950835e1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:28.265633 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-50dae488-35e3-4cdc-bbb6-513b950835e1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] HTTP exception thrown: Instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 could not be found. Aug 04 21:55:28.267329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-50dae488-35e3-4cdc-bbb6-513b950835e1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Request method failure captured: Aug 04 21:55:28.267329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 HTTP/1.1 Aug 04 21:55:28.267329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:55:28.267329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:55:28.267329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:55:28.267329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 21:55:28.267329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:55:28.267329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:55:28.267329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:55:28.267329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:55:28.267329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7D9t8rsKG84MG-XeY6Nlc6oGUGTGzOn1qsEfIgp1-xWWIq9149YutAj8rytKzxl4OvY1D-ym8-Nqng1af7gQx4CCQV_83zm6k1TU_HYRQtFUyhCDmnq8eGjcIc6yEaD-_4bsQnyh21Y-tgkQxsJlI6-_LY5y9tnue57bh7Fq5uafa0U Aug 04 21:55:28.267329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:55:28.267329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:55:28.267329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:55:28.267329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:55:28.267329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:55:28.267329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:55:28.267329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:55:28.267329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:55:28.267329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:55:28.267329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:55:28.268918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8c4ab3c7309249228e42c226277fb14f", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:55:28.268918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:55:28.268918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:55:28.268918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:55:28.268918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:55:28.268918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:55:28.268918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:55:28.268918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: a022ce50f3334e919dcf0008bb6afcf8 Aug 04 21:55:28.268918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:55:28.268918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 21:55:28.268918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 could not be found. Aug 04 21:55:28.268918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': '14c3d2d2-5c7d-4f15-80c9-7cdc84595f10'} Aug 04 21:55:28.269854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:55:28.269854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:55:28.269854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:55:28.269854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:55:28.269854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:55:28.269854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:55:28.269854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:55:28.269854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:55:28.269854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:55:28.269854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:55:28.269854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 could not be found. Aug 04 21:55:28.269854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:55:28.269854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:55:28.269854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:55:28.269854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:55:28.269854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:55:28.269854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:55:28.269854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:55:28.269854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:55:28.269854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:55:28.271388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:55:28.271388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:55:28.271388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:55:28.271388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:55:28.271388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:55:28.271388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:55:28.271388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:55:28.271388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 could not be found. Aug 04 21:55:28.271388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:55:28.271388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:55:28.271388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:55:28.271388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:55:28.271388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:55:28.271388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:55:28.271388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:55:28.271388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:55:28.271388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 could not be found. Aug 04 21:55:28.271388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:55:28.272755 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-50dae488-35e3-4cdc-bbb6-513b950835e1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Returning 404 to user: Instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:55:28.272755 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-50dae488-35e3-4cdc-bbb6-513b950835e1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10" status: 404 len: 111 microversion: 2.1 time: 0.033241 Aug 04 21:55:28.272755 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 526/1055] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:28 2022] GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:55:28.279701 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b061ff5e-f316-470d-b3c0-74d79cac5a79 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '.version_select at 0x7f3c11039c10>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:28.351956 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b061ff5e-f316-470d-b3c0-74d79cac5a79 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-488003268" status: 202 len: 0 microversion: 2.1 time: 0.076667 Aug 04 21:55:28.352568 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 530/1056] 10.222.0.73 () {58 vars in 1218 bytes} [Thu Aug 4 21:55:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-488003268 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:55:29.095606 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e3318131-b528-457a-aaa1-2d03f106985c tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:29.096528 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e3318131-b528-457a-aaa1-2d03f106985c tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:29.102643 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e3318131-b528-457a-aaa1-2d03f106985c tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:29.103125 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e3318131-b528-457a-aaa1-2d03f106985c tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:29.103548 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e3318131-b528-457a-aaa1-2d03f106985c tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:29.104244 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e3318131-b528-457a-aaa1-2d03f106985c tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:29.104685 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e3318131-b528-457a-aaa1-2d03f106985c tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:29.105095 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e3318131-b528-457a-aaa1-2d03f106985c tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:29.256017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e3318131-b528-457a-aaa1-2d03f106985c tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:29.264050 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e3318131-b528-457a-aaa1-2d03f106985c tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1570 microversion: 2.1 time: 0.175631 Aug 04 21:55:29.264627 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 527/1057] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:29 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:29.472686 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2c07a5a4-a6ba-4063-b8a9-7ec39587605d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:29.473268 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2c07a5a4-a6ba-4063-b8a9-7ec39587605d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:29.480015 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2c07a5a4-a6ba-4063-b8a9-7ec39587605d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:29.480506 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2c07a5a4-a6ba-4063-b8a9-7ec39587605d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:29.480962 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2c07a5a4-a6ba-4063-b8a9-7ec39587605d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:29.481664 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2c07a5a4-a6ba-4063-b8a9-7ec39587605d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:29.482145 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2c07a5a4-a6ba-4063-b8a9-7ec39587605d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:29.482565 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2c07a5a4-a6ba-4063-b8a9-7ec39587605d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:29.567835 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-2c07a5a4-a6ba-4063-b8a9-7ec39587605d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lazy-loading 'services' on Instance uuid 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:55:29.760153 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2c07a5a4-a6ba-4063-b8a9-7ec39587605d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39/os-volume_attachments/7ecb0fca-a2a9-4dc6-883b-cf87f407b809" status: 202 len: 0 microversion: 2.1 time: 0.292222 Aug 04 21:55:29.760933 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 531/1058] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 4 21:55:29 2022] DELETE /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39/os-volume_attachments/7ecb0fca-a2a9-4dc6-883b-cf87f407b809 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:55:29.770460 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-46d32e4e-bc67-49e1-80ee-a31b8e4135f0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:29.772649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-46d32e4e-bc67-49e1-80ee-a31b8e4135f0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:29.778988 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-46d32e4e-bc67-49e1-80ee-a31b8e4135f0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:29.779520 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-46d32e4e-bc67-49e1-80ee-a31b8e4135f0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:29.779943 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-46d32e4e-bc67-49e1-80ee-a31b8e4135f0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:29.780640 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-46d32e4e-bc67-49e1-80ee-a31b8e4135f0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:29.781082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-46d32e4e-bc67-49e1-80ee-a31b8e4135f0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:29.781534 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-46d32e4e-bc67-49e1-80ee-a31b8e4135f0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:29.817102 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-46d32e4e-bc67-49e1-80ee-a31b8e4135f0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050745 Aug 04 21:55:29.817665 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 528/1059] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:55:29 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:55:30.285941 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-82461fe9-a013-46d9-8e7b-a4d820cc2d1d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:30.286671 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-82461fe9-a013-46d9-8e7b-a4d820cc2d1d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:30.293040 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-82461fe9-a013-46d9-8e7b-a4d820cc2d1d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:30.294081 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-82461fe9-a013-46d9-8e7b-a4d820cc2d1d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:30.294655 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-82461fe9-a013-46d9-8e7b-a4d820cc2d1d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:30.295528 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-82461fe9-a013-46d9-8e7b-a4d820cc2d1d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:30.295981 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-82461fe9-a013-46d9-8e7b-a4d820cc2d1d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:30.296406 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-82461fe9-a013-46d9-8e7b-a4d820cc2d1d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:30.438191 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-82461fe9-a013-46d9-8e7b-a4d820cc2d1d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:30.445958 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-82461fe9-a013-46d9-8e7b-a4d820cc2d1d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1570 microversion: 2.1 time: 0.164381 Aug 04 21:55:30.446561 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 532/1060] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:30 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:30.829590 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c2399a24-72a5-4c41-9229-1e74b9438f4f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:30.831770 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c2399a24-72a5-4c41-9229-1e74b9438f4f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:30.838338 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c2399a24-72a5-4c41-9229-1e74b9438f4f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:30.838829 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c2399a24-72a5-4c41-9229-1e74b9438f4f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:30.839262 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c2399a24-72a5-4c41-9229-1e74b9438f4f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:30.839953 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c2399a24-72a5-4c41-9229-1e74b9438f4f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:30.840411 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c2399a24-72a5-4c41-9229-1e74b9438f4f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:30.840836 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c2399a24-72a5-4c41-9229-1e74b9438f4f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:30.872303 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c2399a24-72a5-4c41-9229-1e74b9438f4f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046623 Aug 04 21:55:30.873907 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 529/1061] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:55:30 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:55:31.468699 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-007e9307-bbc9-4a37-8d31-2a0298354fdc tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:31.469314 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-007e9307-bbc9-4a37-8d31-2a0298354fdc tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:31.476143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-007e9307-bbc9-4a37-8d31-2a0298354fdc tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:31.476636 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-007e9307-bbc9-4a37-8d31-2a0298354fdc tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:31.477077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-007e9307-bbc9-4a37-8d31-2a0298354fdc tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:31.477773 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-007e9307-bbc9-4a37-8d31-2a0298354fdc tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:31.478266 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-007e9307-bbc9-4a37-8d31-2a0298354fdc tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:31.478693 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-007e9307-bbc9-4a37-8d31-2a0298354fdc tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:31.640820 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-007e9307-bbc9-4a37-8d31-2a0298354fdc tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:31.649439 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-007e9307-bbc9-4a37-8d31-2a0298354fdc tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1570 microversion: 2.1 time: 0.184026 Aug 04 21:55:31.649439 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 533/1062] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:31 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1570 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:31.885811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-4b0e1b9a-e11e-4fc3-9160-4772020cf9e0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:31.888070 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-4b0e1b9a-e11e-4fc3-9160-4772020cf9e0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:31.895375 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4b0e1b9a-e11e-4fc3-9160-4772020cf9e0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:31.895846 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4b0e1b9a-e11e-4fc3-9160-4772020cf9e0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:31.896405 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4b0e1b9a-e11e-4fc3-9160-4772020cf9e0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:31.897097 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4b0e1b9a-e11e-4fc3-9160-4772020cf9e0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:31.897541 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4b0e1b9a-e11e-4fc3-9160-4772020cf9e0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:31.897956 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4b0e1b9a-e11e-4fc3-9160-4772020cf9e0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:31.927407 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-4b0e1b9a-e11e-4fc3-9160-4772020cf9e0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045744 Aug 04 21:55:31.927968 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 530/1063] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:55:31 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:55:31.992291 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e93a8704-a8f5-4a9a-bca6-2ab9876953b8 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:31.992788 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e93a8704-a8f5-4a9a-bca6-2ab9876953b8 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:31.999707 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e93a8704-a8f5-4a9a-bca6-2ab9876953b8 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:32.000206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e93a8704-a8f5-4a9a-bca6-2ab9876953b8 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:32.000639 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e93a8704-a8f5-4a9a-bca6-2ab9876953b8 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:32.001340 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e93a8704-a8f5-4a9a-bca6-2ab9876953b8 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:32.001802 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e93a8704-a8f5-4a9a-bca6-2ab9876953b8 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:32.002267 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e93a8704-a8f5-4a9a-bca6-2ab9876953b8 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:32.028504 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e93a8704-a8f5-4a9a-bca6-2ab9876953b8 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Going to try to terminate instance {{(pid=136342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:55:32.333669 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e93a8704-a8f5-4a9a-bca6-2ab9876953b8 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 204 len: 0 microversion: 2.1 time: 0.344836 Aug 04 21:55:32.334486 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 534/1064] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:55:31 2022] DELETE /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:55:32.343179 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-9ea48624-41ff-451c-9b04-08678076b0f7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:32.343943 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-9ea48624-41ff-451c-9b04-08678076b0f7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:32.350082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9ea48624-41ff-451c-9b04-08678076b0f7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:32.350560 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9ea48624-41ff-451c-9b04-08678076b0f7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:32.350988 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9ea48624-41ff-451c-9b04-08678076b0f7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:32.351676 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9ea48624-41ff-451c-9b04-08678076b0f7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:32.352120 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9ea48624-41ff-451c-9b04-08678076b0f7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:32.352537 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9ea48624-41ff-451c-9b04-08678076b0f7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:32.488784 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-9ea48624-41ff-451c-9b04-08678076b0f7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:32.496780 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-9ea48624-41ff-451c-9b04-08678076b0f7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1682 microversion: 2.1 time: 0.157986 Aug 04 21:55:32.497366 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 531/1065] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:32 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:32.669367 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-c1a442a6-b2ec-4ac6-96db-2f374639a0b2 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:32.669968 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-c1a442a6-b2ec-4ac6-96db-2f374639a0b2 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:32.677200 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c1a442a6-b2ec-4ac6-96db-2f374639a0b2 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:32.677686 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c1a442a6-b2ec-4ac6-96db-2f374639a0b2 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:32.678144 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c1a442a6-b2ec-4ac6-96db-2f374639a0b2 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:32.678835 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c1a442a6-b2ec-4ac6-96db-2f374639a0b2 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:32.679283 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c1a442a6-b2ec-4ac6-96db-2f374639a0b2 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:32.679699 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c1a442a6-b2ec-4ac6-96db-2f374639a0b2 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:32.817471 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-c1a442a6-b2ec-4ac6-96db-2f374639a0b2 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:32.827409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-c1a442a6-b2ec-4ac6-96db-2f374639a0b2 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1570 microversion: 2.1 time: 0.162271 Aug 04 21:55:32.827980 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 535/1066] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:32 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:55:33.518987 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-bcba1812-d054-4721-8c19-315d992f319e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:33.519698 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-bcba1812-d054-4721-8c19-315d992f319e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:33.526718 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bcba1812-d054-4721-8c19-315d992f319e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:33.527204 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bcba1812-d054-4721-8c19-315d992f319e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:33.527633 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bcba1812-d054-4721-8c19-315d992f319e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:33.528332 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bcba1812-d054-4721-8c19-315d992f319e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:33.528778 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bcba1812-d054-4721-8c19-315d992f319e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:33.529195 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-bcba1812-d054-4721-8c19-315d992f319e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:33.676943 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-bcba1812-d054-4721-8c19-315d992f319e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:33.684829 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-bcba1812-d054-4721-8c19-315d992f319e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1682 microversion: 2.1 time: 0.170368 Aug 04 21:55:33.685406 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 532/1067] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:33 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:33.850536 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b3088590-97b1-45be-b8d4-c4642bf7376e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:33.851173 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b3088590-97b1-45be-b8d4-c4642bf7376e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:33.857818 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b3088590-97b1-45be-b8d4-c4642bf7376e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:33.858391 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b3088590-97b1-45be-b8d4-c4642bf7376e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:33.858930 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b3088590-97b1-45be-b8d4-c4642bf7376e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:33.859630 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b3088590-97b1-45be-b8d4-c4642bf7376e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:33.860078 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b3088590-97b1-45be-b8d4-c4642bf7376e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:33.860505 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b3088590-97b1-45be-b8d4-c4642bf7376e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:33.865003 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:55:34.006483 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b3088590-97b1-45be-b8d4-c4642bf7376e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:34.014324 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b3088590-97b1-45be-b8d4-c4642bf7376e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1570 microversion: 2.1 time: 0.167810 Aug 04 21:55:34.015248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 536/1068] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:33 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:34.706841 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c5f5ec6d-317e-4257-9203-1d422a955d47 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:34.707533 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c5f5ec6d-317e-4257-9203-1d422a955d47 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:34.714078 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c5f5ec6d-317e-4257-9203-1d422a955d47 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:34.714665 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c5f5ec6d-317e-4257-9203-1d422a955d47 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:34.715188 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c5f5ec6d-317e-4257-9203-1d422a955d47 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:34.715887 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c5f5ec6d-317e-4257-9203-1d422a955d47 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:34.716332 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c5f5ec6d-317e-4257-9203-1d422a955d47 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:34.716747 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c5f5ec6d-317e-4257-9203-1d422a955d47 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:34.859914 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-c5f5ec6d-317e-4257-9203-1d422a955d47 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:34.870894 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c5f5ec6d-317e-4257-9203-1d422a955d47 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1682 microversion: 2.1 time: 0.167691 Aug 04 21:55:34.871517 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 533/1069] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:34 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:35.036807 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d876ac61-48ab-4c2e-96e6-39c3e9390587 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:35.037409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d876ac61-48ab-4c2e-96e6-39c3e9390587 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:35.044329 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d876ac61-48ab-4c2e-96e6-39c3e9390587 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:35.044824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d876ac61-48ab-4c2e-96e6-39c3e9390587 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:35.045289 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d876ac61-48ab-4c2e-96e6-39c3e9390587 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:35.046555 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d876ac61-48ab-4c2e-96e6-39c3e9390587 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:35.047103 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d876ac61-48ab-4c2e-96e6-39c3e9390587 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:35.047578 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d876ac61-48ab-4c2e-96e6-39c3e9390587 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:35.250560 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:55:35.252149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Thu Aug 4 21:55:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:55:35.304638 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d876ac61-48ab-4c2e-96e6-39c3e9390587 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:35.312728 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d876ac61-48ab-4c2e-96e6-39c3e9390587 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1570 microversion: 2.1 time: 0.279834 Aug 04 21:55:35.313303 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 537/1070] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:35 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1570 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:35.493324 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-123d0f61-6b0a-4313-9347-3e6a7d4fc130 req-f8334459-943d-43ff-8894-51d9a551c229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f9071d4-b230-4be2-aadd-ef84b2cd0e39", "name": "network-vif-deleted", "tag": "8f85582c-e289-4635-88d7-589adab599e9"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:55:35.505496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-123d0f61-6b0a-4313-9347-3e6a7d4fc130 req-f8334459-943d-43ff-8894-51d9a551c229 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:35.506153 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-123d0f61-6b0a-4313-9347-3e6a7d4fc130 req-f8334459-943d-43ff-8894-51d9a551c229 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:35.506610 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-123d0f61-6b0a-4313-9347-3e6a7d4fc130 req-f8334459-943d-43ff-8894-51d9a551c229 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:35.520173 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-123d0f61-6b0a-4313-9347-3e6a7d4fc130 req-f8334459-943d-43ff-8894-51d9a551c229 service nova] Creating event network-vif-deleted:8f85582c-e289-4635-88d7-589adab599e9 for instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 on hv-cinder-85220 Aug 04 21:55:35.526090 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-123d0f61-6b0a-4313-9347-3e6a7d4fc130 req-f8334459-943d-43ff-8894-51d9a551c229 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037205 Aug 04 21:55:35.528150 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 534/1071] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:55:35.900248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-865a968c-b16d-4157-89a5-35362a279f93 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:35.900849 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-865a968c-b16d-4157-89a5-35362a279f93 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:35.907330 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-865a968c-b16d-4157-89a5-35362a279f93 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:35.907880 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-865a968c-b16d-4157-89a5-35362a279f93 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:35.912149 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-865a968c-b16d-4157-89a5-35362a279f93 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:35.912149 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-865a968c-b16d-4157-89a5-35362a279f93 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:35.912149 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-865a968c-b16d-4157-89a5-35362a279f93 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:35.912149 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-865a968c-b16d-4157-89a5-35362a279f93 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:35.945974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-865a968c-b16d-4157-89a5-35362a279f93 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:35.946241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-865a968c-b16d-4157-89a5-35362a279f93 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:35.946674 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-865a968c-b16d-4157-89a5-35362a279f93 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:35.947127 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-865a968c-b16d-4157-89a5-35362a279f93 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lazy-loading 'fault' on Instance uuid 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:55:35.995476 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-865a968c-b16d-4157-89a5-35362a279f93 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:36.006318 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-865a968c-b16d-4157-89a5-35362a279f93 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 200 len: 1331 microversion: 2.1 time: 0.110012 Aug 04 21:55:36.006906 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 538/1072] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:35 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:36.335004 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-62f30fbc-b503-48b1-a82e-887486a84091 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:36.335826 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-62f30fbc-b503-48b1-a82e-887486a84091 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:36.343456 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62f30fbc-b503-48b1-a82e-887486a84091 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:36.343951 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62f30fbc-b503-48b1-a82e-887486a84091 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:36.344418 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62f30fbc-b503-48b1-a82e-887486a84091 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:36.345127 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62f30fbc-b503-48b1-a82e-887486a84091 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:36.345577 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62f30fbc-b503-48b1-a82e-887486a84091 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:36.346000 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62f30fbc-b503-48b1-a82e-887486a84091 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:36.510598 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-62f30fbc-b503-48b1-a82e-887486a84091 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:36.514756 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:55:36.519639 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-62f30fbc-b503-48b1-a82e-887486a84091 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1570 microversion: 2.1 time: 0.188991 Aug 04 21:55:36.520472 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 535/1073] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:36 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1570 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:37.028784 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8ba66d84-90bc-45c1-a4a6-0e0b3bf96a62 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:37.029482 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8ba66d84-90bc-45c1-a4a6-0e0b3bf96a62 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:37.035960 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8ba66d84-90bc-45c1-a4a6-0e0b3bf96a62 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:37.036439 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8ba66d84-90bc-45c1-a4a6-0e0b3bf96a62 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:37.036868 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8ba66d84-90bc-45c1-a4a6-0e0b3bf96a62 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:37.037560 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8ba66d84-90bc-45c1-a4a6-0e0b3bf96a62 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:37.038039 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8ba66d84-90bc-45c1-a4a6-0e0b3bf96a62 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:37.038464 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8ba66d84-90bc-45c1-a4a6-0e0b3bf96a62 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:37.051992 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-8ba66d84-90bc-45c1-a4a6-0e0b3bf96a62 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] HTTP exception thrown: Instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 could not be found. Aug 04 21:55:37.053558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8ba66d84-90bc-45c1-a4a6-0e0b3bf96a62 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Request method failure captured: Aug 04 21:55:37.053558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 HTTP/1.1 Aug 04 21:55:37.053558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:55:37.053558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:55:37.053558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:55:37.053558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:55:37.053558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:55:37.053558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:55:37.053558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:55:37.053558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:55:37.053558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7D9t8rsKG84MG-XeY6Nlc6oGUGTGzOn1qsEfIgp1-xWWIq9149YutAj8rytKzxl4OvY1D-ym8-Nqng1af7gQx4CCQV_83zm6k1TU_HYRQtFUyhCDmnq8eGjcIc6yEaD-_4bsQnyh21Y-tgkQxsJlI6-_LY5y9tnue57bh7Fq5uafa0U Aug 04 21:55:37.053558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:55:37.053558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:55:37.053558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:55:37.053558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:55:37.053558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:55:37.053558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:55:37.053558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:55:37.053558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:55:37.053558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:55:37.053558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:55:37.055204 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8c4ab3c7309249228e42c226277fb14f", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:55:37.055204 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:55:37.055204 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:55:37.055204 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:55:37.055204 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:55:37.055204 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:55:37.055204 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:55:37.055204 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: a022ce50f3334e919dcf0008bb6afcf8 Aug 04 21:55:37.055204 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:55:37.055204 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:55:37.055204 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 could not be found. Aug 04 21:55:37.055204 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': '1f9071d4-b230-4be2-aadd-ef84b2cd0e39'} Aug 04 21:55:37.056084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:55:37.056084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:55:37.056084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:55:37.056084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:55:37.056084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:55:37.056084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:55:37.056084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:55:37.056084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:55:37.056084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:55:37.056084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:55:37.056084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 could not be found. Aug 04 21:55:37.056084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:55:37.056084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:55:37.056084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:55:37.056084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:55:37.056084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:55:37.056084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:55:37.056084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:55:37.056084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:55:37.056084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:55:37.057386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:55:37.057386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:55:37.057386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:55:37.057386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:55:37.057386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:55:37.057386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:55:37.057386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:55:37.057386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 could not be found. Aug 04 21:55:37.057386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:55:37.057386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:55:37.057386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:55:37.057386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:55:37.057386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:55:37.057386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:55:37.057386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:55:37.057386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:55:37.057386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 could not be found. Aug 04 21:55:37.057386 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:55:37.058571 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8ba66d84-90bc-45c1-a4a6-0e0b3bf96a62 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Returning 404 to user: Instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:55:37.058571 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8ba66d84-90bc-45c1-a4a6-0e0b3bf96a62 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 404 len: 111 microversion: 2.1 time: 0.030101 Aug 04 21:55:37.058571 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 539/1074] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:37 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:55:37.064885 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-dc6efc88-ee58-4a26-b287-07580850e706 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '.version_select at 0x7f3c107d8820>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:37.179341 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-dc6efc88-ee58-4a26-b287-07580850e706 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1317397069" status: 202 len: 0 microversion: 2.1 time: 0.119023 Aug 04 21:55:37.183531 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 536/1075] 10.222.0.73 () {58 vars in 1221 bytes} [Thu Aug 4 21:55:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1317397069 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:55:37.540905 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-62744ef3-bf88-4f4b-b4e3-f21ea0b7592a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:37.541517 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-62744ef3-bf88-4f4b-b4e3-f21ea0b7592a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:37.549017 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-62744ef3-bf88-4f4b-b4e3-f21ea0b7592a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:37.549518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-62744ef3-bf88-4f4b-b4e3-f21ea0b7592a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:37.549957 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-62744ef3-bf88-4f4b-b4e3-f21ea0b7592a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:37.550731 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-62744ef3-bf88-4f4b-b4e3-f21ea0b7592a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:37.551221 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-62744ef3-bf88-4f4b-b4e3-f21ea0b7592a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:37.551650 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-62744ef3-bf88-4f4b-b4e3-f21ea0b7592a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:37.695417 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-62744ef3-bf88-4f4b-b4e3-f21ea0b7592a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:37.704145 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-62744ef3-bf88-4f4b-b4e3-f21ea0b7592a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1570 microversion: 2.1 time: 0.167059 Aug 04 21:55:37.705159 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 540/1076] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:37 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:38.029912 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c874327a-db32-482f-99f6-3c728049a772 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Action: 'create', calling method: .version_select at 0x7f3c107a2b80>, body: {"keypair": {"name": "tempest-keypair-2100646338", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJikjV9ysUR8mdk7tqzcewSc3Zj8n+NKQ++SpbBTJD+AVVmLI0yV3E/S64fhLiJ8ah5eXW/+1cTq8NvLnlolTMh/g7BrQzFwF+OM4IldqmywxDTiBBUjSF2WmYCYUvhOoA=="}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:55:38.046934 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-c874327a-db32-482f-99f6-3c728049a772 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Getting quotas for project 8c4ab3c7309249228e42c226277fb14f. Resources: {'key_pairs'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:55:38.052396 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-c874327a-db32-482f-99f6-3c728049a772 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Getting quotas for user a022ce50f3334e919dcf0008bb6afcf8 and project 8c4ab3c7309249228e42c226277fb14f. Resources: {'key_pairs'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:55:38.129484 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c874327a-db32-482f-99f6-3c728049a772 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.104323 Aug 04 21:55:38.130114 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 537/1077] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 4 21:55:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:55:38.726880 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-82a04e08-376f-45c4-a07b-3618cfa95460 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:38.727500 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-82a04e08-376f-45c4-a07b-3618cfa95460 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:38.734136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-82a04e08-376f-45c4-a07b-3618cfa95460 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:38.734595 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-82a04e08-376f-45c4-a07b-3618cfa95460 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:38.735035 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-82a04e08-376f-45c4-a07b-3618cfa95460 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:38.735742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-82a04e08-376f-45c4-a07b-3618cfa95460 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:38.736194 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-82a04e08-376f-45c4-a07b-3618cfa95460 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:38.736617 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-82a04e08-376f-45c4-a07b-3618cfa95460 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:38.891965 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-82a04e08-376f-45c4-a07b-3618cfa95460 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:38.899806 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-82a04e08-376f-45c4-a07b-3618cfa95460 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1570 microversion: 2.1 time: 0.178313 Aug 04 21:55:38.901143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 541/1078] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:38 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:39.924880 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2d1d873a-849b-44b6-9d94-3f89c0ccea5d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:39.925537 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-2d1d873a-849b-44b6-9d94-3f89c0ccea5d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:39.932227 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2d1d873a-849b-44b6-9d94-3f89c0ccea5d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:39.932705 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2d1d873a-849b-44b6-9d94-3f89c0ccea5d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:39.933134 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2d1d873a-849b-44b6-9d94-3f89c0ccea5d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:39.933826 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2d1d873a-849b-44b6-9d94-3f89c0ccea5d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:39.934310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2d1d873a-849b-44b6-9d94-3f89c0ccea5d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:39.934726 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2d1d873a-849b-44b6-9d94-3f89c0ccea5d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:40.160447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2d1d873a-849b-44b6-9d94-3f89c0ccea5d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:40.169352 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2d1d873a-849b-44b6-9d94-3f89c0ccea5d tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1570 microversion: 2.1 time: 0.248392 Aug 04 21:55:40.171777 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 538/1079] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:39 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1570 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:40.492178 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-69925cf7-122d-475c-a56f-d07058249378 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1607126298", "imageRef": "fca0c9ba-fb0a-4f30-932f-84d5253674ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7a01edd-380d-4680-81ec-9f1437601985"}], "security_groups": [{"name": "tempest-securitygroup--792055329"}], "key_name": "tempest-keypair-2100646338", "user_data": "}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:55:40.605761 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.network.neutron [None req-69925cf7-122d-475c-a56f-d07058249378 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] validate_networks() for [('f7a01edd-380d-4680-81ec-9f1437601985', None, None, None, None, None)] {{(pid=136342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:55:41.001901 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-69925cf7-122d-475c-a56f-d07058249378 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Flavor limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:55:41.002571 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-69925cf7-122d-475c-a56f-d07058249378 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Image limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:55:41.003188 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-69925cf7-122d-475c-a56f-d07058249378 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Flavor pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:55:41.003676 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-69925cf7-122d-475c-a56f-d07058249378 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Image pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:55:41.004274 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-69925cf7-122d-475c-a56f-d07058249378 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:55:41.013657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-69925cf7-122d-475c-a56f-d07058249378 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:41.014305 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-69925cf7-122d-475c-a56f-d07058249378 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:41.014768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-69925cf7-122d-475c-a56f-d07058249378 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:41.015581 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-69925cf7-122d-475c-a56f-d07058249378 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:41.015938 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-69925cf7-122d-475c-a56f-d07058249378 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:41.016356 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-69925cf7-122d-475c-a56f-d07058249378 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:41.033263 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-69925cf7-122d-475c-a56f-d07058249378 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Getting quotas for project 8c4ab3c7309249228e42c226277fb14f. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:55:41.037328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-69925cf7-122d-475c-a56f-d07058249378 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Getting quotas for user a022ce50f3334e919dcf0008bb6afcf8 and project 8c4ab3c7309249228e42c226277fb14f. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:55:41.051600 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-69925cf7-122d-475c-a56f-d07058249378 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Going to run 1 instances... {{(pid=136342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:55:41.054028 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-69925cf7-122d-475c-a56f-d07058249378 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca0c9ba-fb0a-4f30-932f-84d5253674ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:55:41.193803 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-04454851-87c4-4cf3-b393-ce9db378d63f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:41.194502 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-04454851-87c4-4cf3-b393-ce9db378d63f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:41.201421 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-04454851-87c4-4cf3-b393-ce9db378d63f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:41.201981 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-04454851-87c4-4cf3-b393-ce9db378d63f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:41.202441 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-04454851-87c4-4cf3-b393-ce9db378d63f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:41.203142 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-04454851-87c4-4cf3-b393-ce9db378d63f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:41.203587 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-04454851-87c4-4cf3-b393-ce9db378d63f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:41.203999 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-04454851-87c4-4cf3-b393-ce9db378d63f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:41.244781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-69925cf7-122d-475c-a56f-d07058249378 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.756966 Aug 04 21:55:41.245809 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 542/1080] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 4 21:55:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:55:41.257649 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f74f4618-6129-45d6-b599-2d5a8e04a49c tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:41.258293 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-f74f4618-6129-45d6-b599-2d5a8e04a49c tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:41.322634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-f74f4618-6129-45d6-b599-2d5a8e04a49c tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:41.332442 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-f74f4618-6129-45d6-b599-2d5a8e04a49c tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b" status: 200 len: 1242 microversion: 2.1 time: 0.078614 Aug 04 21:55:41.333396 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 543/1081] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:41 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:55:41.372059 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-04454851-87c4-4cf3-b393-ce9db378d63f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:41.380752 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-04454851-87c4-4cf3-b393-ce9db378d63f tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1570 microversion: 2.1 time: 0.191001 Aug 04 21:55:41.381345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 539/1082] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:41 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1570 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:55:42.355040 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f478ad13-ce28-4fea-b791-4d4b80646455 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:42.355664 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-f478ad13-ce28-4fea-b791-4d4b80646455 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:42.363411 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f478ad13-ce28-4fea-b791-4d4b80646455 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:42.363987 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f478ad13-ce28-4fea-b791-4d4b80646455 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:42.364421 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f478ad13-ce28-4fea-b791-4d4b80646455 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:42.365125 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f478ad13-ce28-4fea-b791-4d4b80646455 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:42.365579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f478ad13-ce28-4fea-b791-4d4b80646455 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:42.366046 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f478ad13-ce28-4fea-b791-4d4b80646455 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:42.402558 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-74c89eea-2dd4-4f44-a589-90ed9c2a62b3 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:42.403275 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-74c89eea-2dd4-4f44-a589-90ed9c2a62b3 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:42.412081 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-74c89eea-2dd4-4f44-a589-90ed9c2a62b3 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:42.412482 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-74c89eea-2dd4-4f44-a589-90ed9c2a62b3 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:42.413033 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-74c89eea-2dd4-4f44-a589-90ed9c2a62b3 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:42.413740 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-74c89eea-2dd4-4f44-a589-90ed9c2a62b3 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:42.414219 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-74c89eea-2dd4-4f44-a589-90ed9c2a62b3 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:42.414639 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-74c89eea-2dd4-4f44-a589-90ed9c2a62b3 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:42.433234 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-f478ad13-ce28-4fea-b791-4d4b80646455 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:42.441876 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-f478ad13-ce28-4fea-b791-4d4b80646455 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b" status: 200 len: 1246 microversion: 2.1 time: 0.090927 Aug 04 21:55:42.442483 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 544/1083] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:42 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:42.573048 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-74c89eea-2dd4-4f44-a589-90ed9c2a62b3 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:42.577842 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-74c89eea-2dd4-4f44-a589-90ed9c2a62b3 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1571 microversion: 2.1 time: 0.179065 Aug 04 21:55:42.578522 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 540/1084] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:42 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1571 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:55:42.599259 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-590a7654-ad1c-43b7-8512-8b541e1bd8fa tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:55:42.599849 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-590a7654-ad1c-43b7-8512-8b541e1bd8fa tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:42.606980 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-590a7654-ad1c-43b7-8512-8b541e1bd8fa tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:42.607468 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-590a7654-ad1c-43b7-8512-8b541e1bd8fa tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:42.607894 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-590a7654-ad1c-43b7-8512-8b541e1bd8fa tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:42.609232 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-590a7654-ad1c-43b7-8512-8b541e1bd8fa tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:42.609675 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-590a7654-ad1c-43b7-8512-8b541e1bd8fa tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:42.610203 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-590a7654-ad1c-43b7-8512-8b541e1bd8fa tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:42.640023 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-590a7654-ad1c-43b7-8512-8b541e1bd8fa tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=136342) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 21:55:42.994216 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-590a7654-ad1c-43b7-8512-8b541e1bd8fa tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "POST /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd/action" status: 202 len: 0 microversion: 2.1 time: 0.398669 Aug 04 21:55:42.995340 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 545/1085] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 4 21:55:42 2022] POST /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:55:43.003599 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b48c763c-1ceb-4bfe-bdb0-d50984cfa8f8 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:43.004205 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b48c763c-1ceb-4bfe-bdb0-d50984cfa8f8 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:43.010439 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b48c763c-1ceb-4bfe-bdb0-d50984cfa8f8 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:43.010919 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b48c763c-1ceb-4bfe-bdb0-d50984cfa8f8 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:43.011349 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b48c763c-1ceb-4bfe-bdb0-d50984cfa8f8 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:43.012036 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b48c763c-1ceb-4bfe-bdb0-d50984cfa8f8 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:43.012658 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b48c763c-1ceb-4bfe-bdb0-d50984cfa8f8 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:43.013076 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b48c763c-1ceb-4bfe-bdb0-d50984cfa8f8 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:43.154858 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b48c763c-1ceb-4bfe-bdb0-d50984cfa8f8 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:43.163486 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b48c763c-1ceb-4bfe-bdb0-d50984cfa8f8 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1519 microversion: 2.1 time: 0.163754 Aug 04 21:55:43.164069 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 541/1086] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:42 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:43.463087 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-c6204376-5cef-44f3-ad66-da47a8fa8fdd tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:43.463841 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-c6204376-5cef-44f3-ad66-da47a8fa8fdd tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:43.472383 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c6204376-5cef-44f3-ad66-da47a8fa8fdd tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:43.473870 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c6204376-5cef-44f3-ad66-da47a8fa8fdd tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:43.474503 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c6204376-5cef-44f3-ad66-da47a8fa8fdd tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:43.475584 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c6204376-5cef-44f3-ad66-da47a8fa8fdd tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:43.476054 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c6204376-5cef-44f3-ad66-da47a8fa8fdd tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:43.476681 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c6204376-5cef-44f3-ad66-da47a8fa8fdd tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:43.556242 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-c6204376-5cef-44f3-ad66-da47a8fa8fdd tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:43.567194 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-c6204376-5cef-44f3-ad66-da47a8fa8fdd tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b" status: 200 len: 1302 microversion: 2.1 time: 0.107965 Aug 04 21:55:43.568109 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 546/1087] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:43 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b => generated 1302 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:44.185673 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-24fc3729-a892-4ce1-84ac-05cb57c7d53e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:44.187232 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-24fc3729-a892-4ce1-84ac-05cb57c7d53e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:44.196567 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-9de87eb2-bbfc-4dd6-8527-93c7875a342e req-544a72d2-682c-4b26-9b73-692112050faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028c5cd4-1e11-4bde-8f66-4fdf8ef236fd", "name": "network-vif-unplugged", "status": "completed", "tag": "76694182-b548-439d-b9e0-08a5f1cbd3f7"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:55:44.206793 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-24fc3729-a892-4ce1-84ac-05cb57c7d53e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:44.207020 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-9de87eb2-bbfc-4dd6-8527-93c7875a342e req-544a72d2-682c-4b26-9b73-692112050faf service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:44.207285 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-24fc3729-a892-4ce1-84ac-05cb57c7d53e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:44.207454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-9de87eb2-bbfc-4dd6-8527-93c7875a342e req-544a72d2-682c-4b26-9b73-692112050faf service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:44.207713 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-24fc3729-a892-4ce1-84ac-05cb57c7d53e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:44.207948 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-9de87eb2-bbfc-4dd6-8527-93c7875a342e req-544a72d2-682c-4b26-9b73-692112050faf service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:44.208401 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-24fc3729-a892-4ce1-84ac-05cb57c7d53e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:44.208845 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-24fc3729-a892-4ce1-84ac-05cb57c7d53e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:44.209260 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-24fc3729-a892-4ce1-84ac-05cb57c7d53e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:44.220135 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.compute.server_external_events [req-9de87eb2-bbfc-4dd6-8527-93c7875a342e req-544a72d2-682c-4b26-9b73-692112050faf service nova] Unable to find a host for instance 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd. Dropping event network-vif-unplugged {{(pid=136342) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 21:55:44.221032 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-9de87eb2-bbfc-4dd6-8527-93c7875a342e req-544a72d2-682c-4b26-9b73-692112050faf service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028418 Aug 04 21:55:44.221630 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 547/1088] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 04 21:55:44.377632 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-24fc3729-a892-4ce1-84ac-05cb57c7d53e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:44.386801 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-24fc3729-a892-4ce1-84ac-05cb57c7d53e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1519 microversion: 2.1 time: 0.205075 Aug 04 21:55:44.387409 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 542/1089] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:44 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1519 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:44.590295 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2ca5e938-4e8f-481d-941e-b8617f923b74 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:44.591555 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2ca5e938-4e8f-481d-941e-b8617f923b74 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:44.599177 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2ca5e938-4e8f-481d-941e-b8617f923b74 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:44.600010 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2ca5e938-4e8f-481d-941e-b8617f923b74 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:44.600600 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2ca5e938-4e8f-481d-941e-b8617f923b74 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:44.601611 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2ca5e938-4e8f-481d-941e-b8617f923b74 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:44.602091 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2ca5e938-4e8f-481d-941e-b8617f923b74 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:44.602756 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2ca5e938-4e8f-481d-941e-b8617f923b74 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:44.879996 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2ca5e938-4e8f-481d-941e-b8617f923b74 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:44.887913 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2ca5e938-4e8f-481d-941e-b8617f923b74 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b" status: 200 len: 1367 microversion: 2.1 time: 0.302122 Aug 04 21:55:44.888772 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 548/1090] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:44 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:55:45.409439 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ae1f1a7d-deee-4634-a959-bc48070c1971 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:45.410076 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ae1f1a7d-deee-4634-a959-bc48070c1971 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:45.413624 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-19a67b45-31ab-4009-9092-bdcbb1ddea37 req-35f23768-9120-41ab-ba0a-e303b834d055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebeb1675-f6ec-4a67-98ce-901e1e4f839b", "tag": "fdeca7a7-9d5f-418c-8dd4-09147d83bbee"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:55:45.417919 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ae1f1a7d-deee-4634-a959-bc48070c1971 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:45.418750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ae1f1a7d-deee-4634-a959-bc48070c1971 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:45.419360 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ae1f1a7d-deee-4634-a959-bc48070c1971 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:45.420602 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ae1f1a7d-deee-4634-a959-bc48070c1971 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:45.421058 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ae1f1a7d-deee-4634-a959-bc48070c1971 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:45.421973 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ae1f1a7d-deee-4634-a959-bc48070c1971 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:45.428213 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-19a67b45-31ab-4009-9092-bdcbb1ddea37 req-35f23768-9120-41ab-ba0a-e303b834d055 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:45.429559 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-19a67b45-31ab-4009-9092-bdcbb1ddea37 req-35f23768-9120-41ab-ba0a-e303b834d055 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:45.429559 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-19a67b45-31ab-4009-9092-bdcbb1ddea37 req-35f23768-9120-41ab-ba0a-e303b834d055 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:45.442171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-19a67b45-31ab-4009-9092-bdcbb1ddea37 req-35f23768-9120-41ab-ba0a-e303b834d055 service nova] Creating event network-changed:fdeca7a7-9d5f-418c-8dd4-09147d83bbee for instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b on hv-cinder-85220 Aug 04 21:55:45.448479 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-19a67b45-31ab-4009-9092-bdcbb1ddea37 req-35f23768-9120-41ab-ba0a-e303b834d055 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038609 Aug 04 21:55:45.453202 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 549/1091] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:55:45.575862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ae1f1a7d-deee-4634-a959-bc48070c1971 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:45.583874 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ae1f1a7d-deee-4634-a959-bc48070c1971 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1521 microversion: 2.1 time: 0.178967 Aug 04 21:55:45.584447 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 543/1092] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:45 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:45.914423 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-0bb7ae50-b731-412d-bcd7-53928f696d81 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:45.915046 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-0bb7ae50-b731-412d-bcd7-53928f696d81 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:45.922790 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0bb7ae50-b731-412d-bcd7-53928f696d81 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:45.923277 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0bb7ae50-b731-412d-bcd7-53928f696d81 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:45.923743 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0bb7ae50-b731-412d-bcd7-53928f696d81 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:45.924507 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0bb7ae50-b731-412d-bcd7-53928f696d81 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:45.924960 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0bb7ae50-b731-412d-bcd7-53928f696d81 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:45.925381 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0bb7ae50-b731-412d-bcd7-53928f696d81 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:46.136573 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0bb7ae50-b731-412d-bcd7-53928f696d81 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:46.144313 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-0bb7ae50-b731-412d-bcd7-53928f696d81 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b" status: 200 len: 1367 microversion: 2.1 time: 0.235016 Aug 04 21:55:46.144887 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 550/1093] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:45 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:46.606295 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2890bd48-0a3d-495d-a06d-417bc51965c9 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:46.607501 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-2890bd48-0a3d-495d-a06d-417bc51965c9 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:46.616085 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2890bd48-0a3d-495d-a06d-417bc51965c9 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:46.616885 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2890bd48-0a3d-495d-a06d-417bc51965c9 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:46.634537 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2890bd48-0a3d-495d-a06d-417bc51965c9 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:46.634537 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2890bd48-0a3d-495d-a06d-417bc51965c9 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:46.634537 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2890bd48-0a3d-495d-a06d-417bc51965c9 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:46.634537 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2890bd48-0a3d-495d-a06d-417bc51965c9 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:46.855664 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2890bd48-0a3d-495d-a06d-417bc51965c9 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:46.864259 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2890bd48-0a3d-495d-a06d-417bc51965c9 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1577 microversion: 2.1 time: 0.262536 Aug 04 21:55:46.864932 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 544/1094] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:46 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1577 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:47.165056 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-89a38f68-2493-4260-b673-d6509cd61372 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:47.165738 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-89a38f68-2493-4260-b673-d6509cd61372 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:47.173068 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-89a38f68-2493-4260-b673-d6509cd61372 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:47.173553 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-89a38f68-2493-4260-b673-d6509cd61372 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:47.174340 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-89a38f68-2493-4260-b673-d6509cd61372 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:47.175126 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-89a38f68-2493-4260-b673-d6509cd61372 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:47.175580 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-89a38f68-2493-4260-b673-d6509cd61372 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:47.176003 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-89a38f68-2493-4260-b673-d6509cd61372 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:47.314040 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-89a38f68-2493-4260-b673-d6509cd61372 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:47.321806 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-89a38f68-2493-4260-b673-d6509cd61372 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b" status: 200 len: 1367 microversion: 2.1 time: 0.160823 Aug 04 21:55:47.322408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 551/1095] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:47 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:47.886486 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-0ad3dc69-0035-4bae-ad2b-eb4d3f34fede tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:47.887019 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-0ad3dc69-0035-4bae-ad2b-eb4d3f34fede tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:47.894121 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0ad3dc69-0035-4bae-ad2b-eb4d3f34fede tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:47.894602 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0ad3dc69-0035-4bae-ad2b-eb4d3f34fede tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:47.895037 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0ad3dc69-0035-4bae-ad2b-eb4d3f34fede tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:47.895722 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0ad3dc69-0035-4bae-ad2b-eb4d3f34fede tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:47.896169 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0ad3dc69-0035-4bae-ad2b-eb4d3f34fede tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:47.896587 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-0ad3dc69-0035-4bae-ad2b-eb4d3f34fede tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:48.039854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-0ad3dc69-0035-4bae-ad2b-eb4d3f34fede tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:48.047721 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-0ad3dc69-0035-4bae-ad2b-eb4d3f34fede tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1577 microversion: 2.1 time: 0.165154 Aug 04 21:55:48.048292 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 545/1096] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:47 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:48.342928 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-c4d2a74e-2c4d-4dd8-ae6b-694a0084b3eb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:48.343518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-c4d2a74e-2c4d-4dd8-ae6b-694a0084b3eb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:48.350246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c4d2a74e-2c4d-4dd8-ae6b-694a0084b3eb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:48.350729 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c4d2a74e-2c4d-4dd8-ae6b-694a0084b3eb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:48.351155 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c4d2a74e-2c4d-4dd8-ae6b-694a0084b3eb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:48.351842 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c4d2a74e-2c4d-4dd8-ae6b-694a0084b3eb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:48.352286 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c4d2a74e-2c4d-4dd8-ae6b-694a0084b3eb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:48.352698 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c4d2a74e-2c4d-4dd8-ae6b-694a0084b3eb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:48.484877 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-c4d2a74e-2c4d-4dd8-ae6b-694a0084b3eb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:48.492611 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-c4d2a74e-2c4d-4dd8-ae6b-694a0084b3eb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b" status: 200 len: 1367 microversion: 2.1 time: 0.153603 Aug 04 21:55:48.493177 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 552/1097] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:48 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:49.068671 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c9518b92-917d-440d-8698-325218840fae tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:49.069313 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c9518b92-917d-440d-8698-325218840fae tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:49.071226 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=4 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:55:49.076448 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9518b92-917d-440d-8698-325218840fae tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:49.077071 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9518b92-917d-440d-8698-325218840fae tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:49.077537 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9518b92-917d-440d-8698-325218840fae tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:49.078203 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9518b92-917d-440d-8698-325218840fae tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:49.078648 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9518b92-917d-440d-8698-325218840fae tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:49.079065 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c9518b92-917d-440d-8698-325218840fae tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:49.221223 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-c9518b92-917d-440d-8698-325218840fae tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:49.229027 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c9518b92-917d-440d-8698-325218840fae tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1577 microversion: 2.1 time: 0.164249 Aug 04 21:55:49.233506 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 546/1098] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:49 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:49.514733 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-bf40f090-951a-49f0-8f52-8c5517057d00 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:49.515337 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-bf40f090-951a-49f0-8f52-8c5517057d00 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:49.521847 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bf40f090-951a-49f0-8f52-8c5517057d00 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:49.522372 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bf40f090-951a-49f0-8f52-8c5517057d00 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:49.522806 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bf40f090-951a-49f0-8f52-8c5517057d00 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:49.523510 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bf40f090-951a-49f0-8f52-8c5517057d00 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:49.524271 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bf40f090-951a-49f0-8f52-8c5517057d00 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:49.524388 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bf40f090-951a-49f0-8f52-8c5517057d00 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:49.663095 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-bf40f090-951a-49f0-8f52-8c5517057d00 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:49.671290 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-bf40f090-951a-49f0-8f52-8c5517057d00 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b" status: 200 len: 1367 microversion: 2.1 time: 0.160164 Aug 04 21:55:49.673072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 553/1099] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:49 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:50.253737 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b1cd192f-c66a-452c-82cf-d5a3c7e1299e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:50.254487 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b1cd192f-c66a-452c-82cf-d5a3c7e1299e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:50.260860 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b1cd192f-c66a-452c-82cf-d5a3c7e1299e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:50.261351 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b1cd192f-c66a-452c-82cf-d5a3c7e1299e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:50.261789 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b1cd192f-c66a-452c-82cf-d5a3c7e1299e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:50.262520 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b1cd192f-c66a-452c-82cf-d5a3c7e1299e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:50.262980 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b1cd192f-c66a-452c-82cf-d5a3c7e1299e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:50.263408 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b1cd192f-c66a-452c-82cf-d5a3c7e1299e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:50.403730 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b1cd192f-c66a-452c-82cf-d5a3c7e1299e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:50.411826 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b1cd192f-c66a-452c-82cf-d5a3c7e1299e tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1577 microversion: 2.1 time: 0.163111 Aug 04 21:55:50.412395 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 547/1100] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:50 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:50.692319 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-9721aa4e-4f43-4a29-bd59-ad9fbbf1619b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:50.692932 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-9721aa4e-4f43-4a29-bd59-ad9fbbf1619b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:50.699828 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9721aa4e-4f43-4a29-bd59-ad9fbbf1619b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:50.700395 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9721aa4e-4f43-4a29-bd59-ad9fbbf1619b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:50.700835 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9721aa4e-4f43-4a29-bd59-ad9fbbf1619b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:50.702145 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9721aa4e-4f43-4a29-bd59-ad9fbbf1619b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:50.702642 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9721aa4e-4f43-4a29-bd59-ad9fbbf1619b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:50.703115 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9721aa4e-4f43-4a29-bd59-ad9fbbf1619b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:50.836807 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-9721aa4e-4f43-4a29-bd59-ad9fbbf1619b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:50.845181 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-9721aa4e-4f43-4a29-bd59-ad9fbbf1619b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b" status: 200 len: 1367 microversion: 2.1 time: 0.156811 Aug 04 21:55:50.852908 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 554/1101] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:50 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:51.432672 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-837234cd-fc32-4621-928d-6df4301b3984 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:51.433274 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-837234cd-fc32-4621-928d-6df4301b3984 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:51.440378 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-837234cd-fc32-4621-928d-6df4301b3984 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:51.440859 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-837234cd-fc32-4621-928d-6df4301b3984 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:51.441288 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-837234cd-fc32-4621-928d-6df4301b3984 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:51.441996 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-837234cd-fc32-4621-928d-6df4301b3984 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:51.442467 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-837234cd-fc32-4621-928d-6df4301b3984 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:51.442883 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-837234cd-fc32-4621-928d-6df4301b3984 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:51.580548 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-837234cd-fc32-4621-928d-6df4301b3984 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:51.588004 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-837234cd-fc32-4621-928d-6df4301b3984 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1577 microversion: 2.1 time: 0.159201 Aug 04 21:55:51.588567 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 548/1102] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:51 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:51.872294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-d1858079-3232-4634-bde9-cdd774f6866d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:51.873213 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-d1858079-3232-4634-bde9-cdd774f6866d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:51.875830 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=2 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:55:51.876602 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=8 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:55:51.881891 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d1858079-3232-4634-bde9-cdd774f6866d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:51.882418 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d1858079-3232-4634-bde9-cdd774f6866d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:51.882854 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d1858079-3232-4634-bde9-cdd774f6866d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:51.883557 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d1858079-3232-4634-bde9-cdd774f6866d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:51.884008 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d1858079-3232-4634-bde9-cdd774f6866d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:51.884429 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-d1858079-3232-4634-bde9-cdd774f6866d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:51.888634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:55:52.023928 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-d1858079-3232-4634-bde9-cdd774f6866d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:52.032233 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-d1858079-3232-4634-bde9-cdd774f6866d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b" status: 200 len: 1367 microversion: 2.1 time: 0.163859 Aug 04 21:55:52.036989 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 555/1103] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:51 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:52.341514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-bf43f160-5188-4fcc-9570-a1efd42a234f req-c90d6ea8-411b-4707-a389-f45c63689217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebeb1675-f6ec-4a67-98ce-901e1e4f839b", "name": "network-vif-plugged", "status": "completed", "tag": "fdeca7a7-9d5f-418c-8dd4-09147d83bbee"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:55:52.351733 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-bf43f160-5188-4fcc-9570-a1efd42a234f req-c90d6ea8-411b-4707-a389-f45c63689217 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:52.352203 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-bf43f160-5188-4fcc-9570-a1efd42a234f req-c90d6ea8-411b-4707-a389-f45c63689217 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:52.352628 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-bf43f160-5188-4fcc-9570-a1efd42a234f req-c90d6ea8-411b-4707-a389-f45c63689217 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:52.364463 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-bf43f160-5188-4fcc-9570-a1efd42a234f req-c90d6ea8-411b-4707-a389-f45c63689217 service nova] Creating event network-vif-plugged:fdeca7a7-9d5f-418c-8dd4-09147d83bbee for instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b on hv-cinder-85220 Aug 04 21:55:52.369579 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-bf43f160-5188-4fcc-9570-a1efd42a234f req-c90d6ea8-411b-4707-a389-f45c63689217 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031819 Aug 04 21:55:52.374231 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 549/1104] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:55:52.611025 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-86b8193d-2d85-4a33-b64c-3894309e1a20 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:52.611657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-86b8193d-2d85-4a33-b64c-3894309e1a20 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:52.613865 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:55:52.618710 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-86b8193d-2d85-4a33-b64c-3894309e1a20 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:52.619196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-86b8193d-2d85-4a33-b64c-3894309e1a20 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:52.619635 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-86b8193d-2d85-4a33-b64c-3894309e1a20 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:52.620337 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-86b8193d-2d85-4a33-b64c-3894309e1a20 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:52.620788 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-86b8193d-2d85-4a33-b64c-3894309e1a20 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:52.621212 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-86b8193d-2d85-4a33-b64c-3894309e1a20 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:52.794682 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-86b8193d-2d85-4a33-b64c-3894309e1a20 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:52.802584 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-86b8193d-2d85-4a33-b64c-3894309e1a20 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1577 microversion: 2.1 time: 0.196235 Aug 04 21:55:52.803154 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 556/1105] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:52 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1577 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:53.054630 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f86b1d55-46c0-4afa-93e0-14e3a3eb9bd7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:53.055239 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-f86b1d55-46c0-4afa-93e0-14e3a3eb9bd7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:53.057198 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:55:53.062802 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f86b1d55-46c0-4afa-93e0-14e3a3eb9bd7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:53.064275 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f86b1d55-46c0-4afa-93e0-14e3a3eb9bd7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:53.064275 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f86b1d55-46c0-4afa-93e0-14e3a3eb9bd7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:53.064665 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f86b1d55-46c0-4afa-93e0-14e3a3eb9bd7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:53.064863 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f86b1d55-46c0-4afa-93e0-14e3a3eb9bd7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:53.065280 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f86b1d55-46c0-4afa-93e0-14e3a3eb9bd7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:53.198917 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f86b1d55-46c0-4afa-93e0-14e3a3eb9bd7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:53.207095 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f86b1d55-46c0-4afa-93e0-14e3a3eb9bd7 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b" status: 200 len: 1367 microversion: 2.1 time: 0.157353 Aug 04 21:55:53.207695 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 550/1106] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:53 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:53.823919 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-08c0ad5e-fece-4c1b-ac2d-fdd2999cf33a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:53.824524 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-08c0ad5e-fece-4c1b-ac2d-fdd2999cf33a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:53.831921 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c0ad5e-fece-4c1b-ac2d-fdd2999cf33a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:53.832393 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c0ad5e-fece-4c1b-ac2d-fdd2999cf33a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:53.835569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c0ad5e-fece-4c1b-ac2d-fdd2999cf33a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:53.835569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c0ad5e-fece-4c1b-ac2d-fdd2999cf33a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:53.835569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c0ad5e-fece-4c1b-ac2d-fdd2999cf33a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:53.835569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c0ad5e-fece-4c1b-ac2d-fdd2999cf33a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:53.970832 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-08c0ad5e-fece-4c1b-ac2d-fdd2999cf33a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:53.978361 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-08c0ad5e-fece-4c1b-ac2d-fdd2999cf33a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1577 microversion: 2.1 time: 0.158741 Aug 04 21:55:53.978929 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 557/1107] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:53 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:54.228200 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-62e62ed6-cd65-4166-992b-68d18b677e59 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:54.229045 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-62e62ed6-cd65-4166-992b-68d18b677e59 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:54.237026 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62e62ed6-cd65-4166-992b-68d18b677e59 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:54.237521 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62e62ed6-cd65-4166-992b-68d18b677e59 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:54.237957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62e62ed6-cd65-4166-992b-68d18b677e59 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:54.238896 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62e62ed6-cd65-4166-992b-68d18b677e59 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:54.239522 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62e62ed6-cd65-4166-992b-68d18b677e59 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:54.239952 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-62e62ed6-cd65-4166-992b-68d18b677e59 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:54.386713 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-62e62ed6-cd65-4166-992b-68d18b677e59 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:54.394495 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-62e62ed6-cd65-4166-992b-68d18b677e59 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b" status: 200 len: 1367 microversion: 2.1 time: 0.170111 Aug 04 21:55:54.395066 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 551/1108] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:54 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:54.999611 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-01252ac0-b80b-4e95-a832-6a21140ce9c1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:55.000354 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-01252ac0-b80b-4e95-a832-6a21140ce9c1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:55.006800 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-01252ac0-b80b-4e95-a832-6a21140ce9c1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:55.007282 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-01252ac0-b80b-4e95-a832-6a21140ce9c1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:55.007710 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-01252ac0-b80b-4e95-a832-6a21140ce9c1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:55.008402 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-01252ac0-b80b-4e95-a832-6a21140ce9c1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:55.008851 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-01252ac0-b80b-4e95-a832-6a21140ce9c1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:55.009270 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-01252ac0-b80b-4e95-a832-6a21140ce9c1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:55.143573 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-01252ac0-b80b-4e95-a832-6a21140ce9c1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:55.151265 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-01252ac0-b80b-4e95-a832-6a21140ce9c1 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1577 microversion: 2.1 time: 0.156084 Aug 04 21:55:55.151839 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 558/1109] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:54 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:55.415871 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-aaf9c172-14af-49f3-b2b9-9e2749faad40 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:55.416443 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-aaf9c172-14af-49f3-b2b9-9e2749faad40 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:55.422952 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aaf9c172-14af-49f3-b2b9-9e2749faad40 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:55.423427 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aaf9c172-14af-49f3-b2b9-9e2749faad40 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:55.423853 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aaf9c172-14af-49f3-b2b9-9e2749faad40 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:55.424536 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aaf9c172-14af-49f3-b2b9-9e2749faad40 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:55.424974 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aaf9c172-14af-49f3-b2b9-9e2749faad40 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:55.425386 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aaf9c172-14af-49f3-b2b9-9e2749faad40 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:55.564049 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-aaf9c172-14af-49f3-b2b9-9e2749faad40 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:55.571552 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-aaf9c172-14af-49f3-b2b9-9e2749faad40 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b" status: 200 len: 1556 microversion: 2.1 time: 0.159586 Aug 04 21:55:55.572133 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 552/1110] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:55 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:55:55.593910 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-1029355d-50c0-4d06-b2ef-b9b3a8dac2fc tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:55.594411 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-1029355d-50c0-4d06-b2ef-b9b3a8dac2fc tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:55.600400 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1029355d-50c0-4d06-b2ef-b9b3a8dac2fc tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:55.600878 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1029355d-50c0-4d06-b2ef-b9b3a8dac2fc tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:55.601302 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1029355d-50c0-4d06-b2ef-b9b3a8dac2fc tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:55.601990 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1029355d-50c0-4d06-b2ef-b9b3a8dac2fc tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:55.602461 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1029355d-50c0-4d06-b2ef-b9b3a8dac2fc tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:55.602879 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1029355d-50c0-4d06-b2ef-b9b3a8dac2fc tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:55.685473 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-1029355d-50c0-4d06-b2ef-b9b3a8dac2fc tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095568 Aug 04 21:55:55.686126 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 559/1111] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 4 21:55:55 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:55:56.174759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2cef4542-6882-4254-b5f0-7737bbdb2dc0 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:56.175378 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-2cef4542-6882-4254-b5f0-7737bbdb2dc0 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:56.181152 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2cef4542-6882-4254-b5f0-7737bbdb2dc0 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:56.181624 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2cef4542-6882-4254-b5f0-7737bbdb2dc0 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:56.182081 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2cef4542-6882-4254-b5f0-7737bbdb2dc0 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:56.182772 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2cef4542-6882-4254-b5f0-7737bbdb2dc0 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:56.183219 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2cef4542-6882-4254-b5f0-7737bbdb2dc0 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:56.183639 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2cef4542-6882-4254-b5f0-7737bbdb2dc0 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:56.336363 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2cef4542-6882-4254-b5f0-7737bbdb2dc0 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:56.344269 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2cef4542-6882-4254-b5f0-7737bbdb2dc0 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1577 microversion: 2.1 time: 0.174349 Aug 04 21:55:56.345426 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 553/1112] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:56 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:56.698954 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-f95769f1-4ebd-4f6d-9ad7-52faaa3fd82a req-143b0d1f-7451-4161-8fa9-7bedb3dcfd6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebeb1675-f6ec-4a67-98ce-901e1e4f839b", "tag": "fdeca7a7-9d5f-418c-8dd4-09147d83bbee"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:55:56.708953 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-f95769f1-4ebd-4f6d-9ad7-52faaa3fd82a req-143b0d1f-7451-4161-8fa9-7bedb3dcfd6c service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:56.709430 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-f95769f1-4ebd-4f6d-9ad7-52faaa3fd82a req-143b0d1f-7451-4161-8fa9-7bedb3dcfd6c service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:56.709853 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-f95769f1-4ebd-4f6d-9ad7-52faaa3fd82a req-143b0d1f-7451-4161-8fa9-7bedb3dcfd6c service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:56.722453 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-f95769f1-4ebd-4f6d-9ad7-52faaa3fd82a req-143b0d1f-7451-4161-8fa9-7bedb3dcfd6c service nova] Creating event network-changed:fdeca7a7-9d5f-418c-8dd4-09147d83bbee for instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b on hv-cinder-85220 Aug 04 21:55:56.727827 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-f95769f1-4ebd-4f6d-9ad7-52faaa3fd82a req-143b0d1f-7451-4161-8fa9-7bedb3dcfd6c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033000 Aug 04 21:55:56.728508 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 560/1113] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:55:57.369792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a65f017b-3b83-4153-9412-362f819a67a3 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:57.370878 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a65f017b-3b83-4153-9412-362f819a67a3 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:57.387917 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a65f017b-3b83-4153-9412-362f819a67a3 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:57.388408 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a65f017b-3b83-4153-9412-362f819a67a3 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:57.389363 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a65f017b-3b83-4153-9412-362f819a67a3 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:57.390141 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a65f017b-3b83-4153-9412-362f819a67a3 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:57.390762 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a65f017b-3b83-4153-9412-362f819a67a3 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:57.391189 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a65f017b-3b83-4153-9412-362f819a67a3 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:57.552861 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a65f017b-3b83-4153-9412-362f819a67a3 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:57.563184 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a65f017b-3b83-4153-9412-362f819a67a3 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1577 microversion: 2.1 time: 0.198782 Aug 04 21:55:57.563855 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 554/1114] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:57 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1577 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:58.413122 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-103e6396-6b4a-40df-86e3-f4ab2fbb01e7 req-c7e56199-2890-4211-bc61-645063218004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028c5cd4-1e11-4bde-8f66-4fdf8ef236fd", "name": "network-vif-plugged", "status": "completed", "tag": "76694182-b548-439d-b9e0-08a5f1cbd3f7"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:55:58.423520 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-103e6396-6b4a-40df-86e3-f4ab2fbb01e7 req-c7e56199-2890-4211-bc61-645063218004 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:58.424026 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-103e6396-6b4a-40df-86e3-f4ab2fbb01e7 req-c7e56199-2890-4211-bc61-645063218004 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:58.431533 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-103e6396-6b4a-40df-86e3-f4ab2fbb01e7 req-c7e56199-2890-4211-bc61-645063218004 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:58.435897 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-103e6396-6b4a-40df-86e3-f4ab2fbb01e7 req-c7e56199-2890-4211-bc61-645063218004 service nova] Creating event network-vif-plugged:76694182-b548-439d-b9e0-08a5f1cbd3f7 for instance 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd on hv-cinder-85220 Aug 04 21:55:58.440912 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-103e6396-6b4a-40df-86e3-f4ab2fbb01e7 req-c7e56199-2890-4211-bc61-645063218004 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032425 Aug 04 21:55:58.441697 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 561/1115] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:55:58.584746 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-3edad7d5-9897-414a-9bd4-6f7ca39ed1a7 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:58.585357 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-3edad7d5-9897-414a-9bd4-6f7ca39ed1a7 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:58.591768 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3edad7d5-9897-414a-9bd4-6f7ca39ed1a7 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:58.593051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3edad7d5-9897-414a-9bd4-6f7ca39ed1a7 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:58.597847 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3edad7d5-9897-414a-9bd4-6f7ca39ed1a7 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:58.597847 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3edad7d5-9897-414a-9bd4-6f7ca39ed1a7 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:58.597847 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3edad7d5-9897-414a-9bd4-6f7ca39ed1a7 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:58.597847 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3edad7d5-9897-414a-9bd4-6f7ca39ed1a7 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:58.599104 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=100 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:55:58.733924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-3edad7d5-9897-414a-9bd4-6f7ca39ed1a7 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:58.741692 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-3edad7d5-9897-414a-9bd4-6f7ca39ed1a7 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1577 microversion: 2.1 time: 0.160802 Aug 04 21:55:58.742322 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 555/1116] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:58 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:55:59.765084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-49c7cd9d-8913-4f53-ab95-968a1f6b3946 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:55:59.765799 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-49c7cd9d-8913-4f53-ab95-968a1f6b3946 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:55:59.772412 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-49c7cd9d-8913-4f53-ab95-968a1f6b3946 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:59.772886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-49c7cd9d-8913-4f53-ab95-968a1f6b3946 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:59.773317 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-49c7cd9d-8913-4f53-ab95-968a1f6b3946 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:59.774073 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-49c7cd9d-8913-4f53-ab95-968a1f6b3946 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:55:59.774477 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-49c7cd9d-8913-4f53-ab95-968a1f6b3946 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:55:59.774894 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-49c7cd9d-8913-4f53-ab95-968a1f6b3946 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:55:59.908959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-49c7cd9d-8913-4f53-ab95-968a1f6b3946 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:55:59.916542 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-49c7cd9d-8913-4f53-ab95-968a1f6b3946 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1577 microversion: 2.1 time: 0.156559 Aug 04 21:55:59.917097 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 562/1117] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:55:59 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:56:00.939271 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-be812bba-51e5-4600-95ee-dd814768714a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:56:00.939883 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-be812bba-51e5-4600-95ee-dd814768714a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:56:00.946615 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-be812bba-51e5-4600-95ee-dd814768714a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:56:00.947107 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-be812bba-51e5-4600-95ee-dd814768714a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:56:00.947539 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-be812bba-51e5-4600-95ee-dd814768714a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:56:00.948243 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-be812bba-51e5-4600-95ee-dd814768714a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:56:00.948692 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-be812bba-51e5-4600-95ee-dd814768714a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:56:00.949111 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-be812bba-51e5-4600-95ee-dd814768714a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:56:01.084657 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-be812bba-51e5-4600-95ee-dd814768714a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:56:01.092628 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-be812bba-51e5-4600-95ee-dd814768714a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1564 microversion: 2.1 time: 0.157905 Aug 04 21:56:01.093243 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 556/1118] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:56:00 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:57:12.064132 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=13 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:57:12.064871 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=36 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:57:12.121156 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-30ea2708-0096-42d6-9968-9b451ffc44da tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:12.121654 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-30ea2708-0096-42d6-9968-9b451ffc44da tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:12.128031 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-30ea2708-0096-42d6-9968-9b451ffc44da tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:12.128513 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-30ea2708-0096-42d6-9968-9b451ffc44da tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:12.128944 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-30ea2708-0096-42d6-9968-9b451ffc44da tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:12.129627 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-30ea2708-0096-42d6-9968-9b451ffc44da tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:12.130330 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-30ea2708-0096-42d6-9968-9b451ffc44da tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:12.130752 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-30ea2708-0096-42d6-9968-9b451ffc44da tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:12.152969 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-30ea2708-0096-42d6-9968-9b451ffc44da tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b/ips" status: 200 len: 149 microversion: 2.1 time: 0.094509 Aug 04 21:57:12.153506 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 563/1119] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 4 21:57:12 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b/ips => generated 149 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:57:13.721518 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=13 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:57:13.725225 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=10 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:57:13.727608 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-65c4d1ec-bf6b-42b6-8662-52d924ae8e4b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56034164-2a88-42a7-98e9-d031879c287e"}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:57:13.730049 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-65c4d1ec-bf6b-42b6-8662-52d924ae8e4b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:13.735926 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-65c4d1ec-bf6b-42b6-8662-52d924ae8e4b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:13.736403 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-65c4d1ec-bf6b-42b6-8662-52d924ae8e4b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:13.736875 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-65c4d1ec-bf6b-42b6-8662-52d924ae8e4b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:13.737560 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-65c4d1ec-bf6b-42b6-8662-52d924ae8e4b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:13.738020 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-65c4d1ec-bf6b-42b6-8662-52d924ae8e4b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:13.738453 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-65c4d1ec-bf6b-42b6-8662-52d924ae8e4b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:14.458787 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-65c4d1ec-bf6b-42b6-8662-52d924ae8e4b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "POST /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.738192 Aug 04 21:57:14.459392 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 557/1120] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 4 21:57:13 2022] POST /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b/os-volume_attachments => generated 194 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:57:23.030229 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ecb44f88-b14a-42d0-883f-d8e8d2e85a6a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56034164-2a88-42a7-98e9-d031879c287e"}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:57:23.032654 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ecb44f88-b14a-42d0-883f-d8e8d2e85a6a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:23.034628 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=2 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:57:23.035424 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=4 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:57:23.041023 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ecb44f88-b14a-42d0-883f-d8e8d2e85a6a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:23.041506 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ecb44f88-b14a-42d0-883f-d8e8d2e85a6a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:23.041941 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ecb44f88-b14a-42d0-883f-d8e8d2e85a6a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:23.042657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ecb44f88-b14a-42d0-883f-d8e8d2e85a6a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:23.043110 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ecb44f88-b14a-42d0-883f-d8e8d2e85a6a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:23.043535 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ecb44f88-b14a-42d0-883f-d8e8d2e85a6a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:23.124416 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-ecb44f88-b14a-42d0-883f-d8e8d2e85a6a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] HTTP exception thrown: Invalid volume: volume 56034164-2a88-42a7-98e9-d031879c287e is already attached to instances: ebeb1675-f6ec-4a67-98ce-901e1e4f839b Aug 04 21:57:23.126248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ecb44f88-b14a-42d0-883f-d8e8d2e85a6a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Request method failure captured: Aug 04 21:57:23.126248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: POST /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b/os-volume_attachments HTTP/1.1 Aug 04 21:57:23.126248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:57:23.126248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:57:23.126248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:57:23.126248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 74 Aug 04 21:57:23.126248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:57:23.126248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:57:23.126248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:57:23.126248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:57:23.126248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7D9t8rsKG84MG-XeY6Nlc6oGUGTGzOn1qsEfIgp1-xWWIq9149YutAj8rytKzxl4OvY1D-ym8-Nqng1af7gQx4CCQV_83zm6k1TU_HYRQtFUyhCDmnq8eGjcIc6yEaD-_4bsQnyh21Y-tgkQxsJlI6-_LY5y9tnue57bh7Fq5uafa0U Aug 04 21:57:23.126248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:57:23.126248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:57:23.126248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:57:23.126248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:57:23.126248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:57:23.126248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:57:23.126248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:57:23.126248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:57:23.126248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:57:23.126248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:57:23.128665 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8c4ab3c7309249228e42c226277fb14f", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:57:23.128665 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:57:23.128665 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:57:23.128665 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:57:23.128665 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:57:23.128665 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:57:23.128665 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:57:23.128665 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: a022ce50f3334e919dcf0008bb6afcf8 Aug 04 21:57:23.128665 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:57:23.128665 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Aug 04 21:57:23.128665 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {"volumeAttachment": {"volumeId": "56034164-2a88-42a7-98e9-d031879c287e"}} Aug 04 21:57:23.128665 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:57:23.130387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Invalid volume: volume 56034164-2a88-42a7-98e9-d031879c287e is already attached to instances: ebeb1675-f6ec-4a67-98ce-901e1e4f839b Aug 04 21:57:23.130387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'server_id': 'ebeb1675-f6ec-4a67-98ce-901e1e4f839b', 'body': {'volumeAttachment': {'volumeId': '56034164-2a88-42a7-98e9-d031879c287e'}}} Aug 04 21:57:23.130387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:57:23.130387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:57:23.130387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 21:57:23.130387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 21:57:23.130387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 21:57:23.130387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 21:57:23.130387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 21:57:23.130387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 21:57:23.130387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 21:57:23.130387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 21:57:23.130387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 21:57:23.130387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 21:57:23.130387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 56034164-2a88-42a7-98e9-d031879c287e is already attached to instances: ebeb1675-f6ec-4a67-98ce-901e1e4f839b Aug 04 21:57:23.130387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:57:23.130387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:57:23.130387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:57:23.130387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:57:23.132875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:57:23.132875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:57:23.132875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:57:23.132875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:57:23.132875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:57:23.132875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:57:23.132875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:57:23.132875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:57:23.132875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:57:23.132875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:57:23.132875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:57:23.132875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:57:23.132875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 21:57:23.132875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 21:57:23.132875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 56034164-2a88-42a7-98e9-d031879c287e is already attached to instances: ebeb1675-f6ec-4a67-98ce-901e1e4f839b Aug 04 21:57:23.132875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:57:23.132875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:57:23.132875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:57:23.132875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:57:23.132875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:57:23.135310 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:57:23.135310 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:57:23.135310 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:57:23.135310 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 56034164-2a88-42a7-98e9-d031879c287e is already attached to instances: ebeb1675-f6ec-4a67-98ce-901e1e4f839b Aug 04 21:57:23.135310 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:57:23.135310 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ecb44f88-b14a-42d0-883f-d8e8d2e85a6a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Returning 400 to user: Invalid volume: volume 56034164-2a88-42a7-98e9-d031879c287e is already attached to instances: ebeb1675-f6ec-4a67-98ce-901e1e4f839b {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:57:23.135310 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ecb44f88-b14a-42d0-883f-d8e8d2e85a6a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "POST /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101655 Aug 04 21:57:23.135310 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 564/1121] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 4 21:57:23 2022] POST /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:57:23.193586 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c3ffeafe-6176-480f-9bee-c8e40b87c291 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:23.194184 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c3ffeafe-6176-480f-9bee-c8e40b87c291 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:23.200279 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c3ffeafe-6176-480f-9bee-c8e40b87c291 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:23.200751 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c3ffeafe-6176-480f-9bee-c8e40b87c291 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:23.201177 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c3ffeafe-6176-480f-9bee-c8e40b87c291 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:23.201851 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c3ffeafe-6176-480f-9bee-c8e40b87c291 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:23.202319 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c3ffeafe-6176-480f-9bee-c8e40b87c291 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:23.202735 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c3ffeafe-6176-480f-9bee-c8e40b87c291 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:23.283336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.objects.instance [None req-c3ffeafe-6176-480f-9bee-c8e40b87c291 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lazy-loading 'services' on Instance uuid ebeb1675-f6ec-4a67-98ce-901e1e4f839b {{(pid=136341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:57:23.484174 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c3ffeafe-6176-480f-9bee-c8e40b87c291 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b/os-volume_attachments/56034164-2a88-42a7-98e9-d031879c287e" status: 202 len: 0 microversion: 2.1 time: 0.295649 Aug 04 21:57:23.485033 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 558/1122] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 4 21:57:23 2022] DELETE /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b/os-volume_attachments/56034164-2a88-42a7-98e9-d031879c287e => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:57:23.493164 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-3bf92839-6c4d-460b-b493-7c1a7e2a1b16 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:23.495520 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-3bf92839-6c4d-460b-b493-7c1a7e2a1b16 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:23.501781 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bf92839-6c4d-460b-b493-7c1a7e2a1b16 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:23.502295 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bf92839-6c4d-460b-b493-7c1a7e2a1b16 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:23.502730 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bf92839-6c4d-460b-b493-7c1a7e2a1b16 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:23.503419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bf92839-6c4d-460b-b493-7c1a7e2a1b16 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:23.503871 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bf92839-6c4d-460b-b493-7c1a7e2a1b16 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:23.505007 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bf92839-6c4d-460b-b493-7c1a7e2a1b16 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:23.535939 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-3bf92839-6c4d-460b-b493-7c1a7e2a1b16 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046613 Aug 04 21:57:23.536675 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 565/1123] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:57:23 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:57:24.549267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-45366860-6836-45a7-b80b-74f021c06bd0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:24.552444 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-45366860-6836-45a7-b80b-74f021c06bd0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:24.562169 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-45366860-6836-45a7-b80b-74f021c06bd0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:24.562169 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-45366860-6836-45a7-b80b-74f021c06bd0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:24.562169 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-45366860-6836-45a7-b80b-74f021c06bd0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:24.562169 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-45366860-6836-45a7-b80b-74f021c06bd0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:24.562673 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-45366860-6836-45a7-b80b-74f021c06bd0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:24.562673 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-45366860-6836-45a7-b80b-74f021c06bd0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:24.590492 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-45366860-6836-45a7-b80b-74f021c06bd0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045756 Aug 04 21:57:24.592600 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 559/1124] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:57:24 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:57:25.602819 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ea3346d9-101a-40c9-8f00-ee894d9aa1f1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:25.605013 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ea3346d9-101a-40c9-8f00-ee894d9aa1f1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:25.611563 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ea3346d9-101a-40c9-8f00-ee894d9aa1f1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:25.612036 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ea3346d9-101a-40c9-8f00-ee894d9aa1f1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:25.612461 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ea3346d9-101a-40c9-8f00-ee894d9aa1f1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:25.613136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ea3346d9-101a-40c9-8f00-ee894d9aa1f1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:25.613578 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ea3346d9-101a-40c9-8f00-ee894d9aa1f1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:25.614075 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ea3346d9-101a-40c9-8f00-ee894d9aa1f1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:25.642829 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ea3346d9-101a-40c9-8f00-ee894d9aa1f1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044008 Aug 04 21:57:25.643365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 566/1125] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:57:25 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:57:25.704946 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-41d43f5c-6eb3-4b1a-9e02-5e7b0e1d6726 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:25.705434 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-41d43f5c-6eb3-4b1a-9e02-5e7b0e1d6726 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:25.712671 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-41d43f5c-6eb3-4b1a-9e02-5e7b0e1d6726 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:25.713144 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-41d43f5c-6eb3-4b1a-9e02-5e7b0e1d6726 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:25.713573 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-41d43f5c-6eb3-4b1a-9e02-5e7b0e1d6726 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:25.714292 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-41d43f5c-6eb3-4b1a-9e02-5e7b0e1d6726 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:25.714718 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-41d43f5c-6eb3-4b1a-9e02-5e7b0e1d6726 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:25.715130 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-41d43f5c-6eb3-4b1a-9e02-5e7b0e1d6726 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:25.740265 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-41d43f5c-6eb3-4b1a-9e02-5e7b0e1d6726 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Going to try to terminate instance {{(pid=136341) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:57:26.031039 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-41d43f5c-6eb3-4b1a-9e02-5e7b0e1d6726 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b" status: 204 len: 0 microversion: 2.1 time: 0.329596 Aug 04 21:57:26.031622 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 560/1126] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:57:25 2022] DELETE /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:57:26.040252 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b3fbb5b9-9e40-4ff2-9090-2019f86dff9e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:26.040865 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b3fbb5b9-9e40-4ff2-9090-2019f86dff9e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:26.046997 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b3fbb5b9-9e40-4ff2-9090-2019f86dff9e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:26.047476 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b3fbb5b9-9e40-4ff2-9090-2019f86dff9e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:26.047901 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b3fbb5b9-9e40-4ff2-9090-2019f86dff9e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:26.048579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b3fbb5b9-9e40-4ff2-9090-2019f86dff9e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:26.049024 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b3fbb5b9-9e40-4ff2-9090-2019f86dff9e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:26.049440 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b3fbb5b9-9e40-4ff2-9090-2019f86dff9e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:26.186076 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b3fbb5b9-9e40-4ff2-9090-2019f86dff9e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:26.193485 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b3fbb5b9-9e40-4ff2-9090-2019f86dff9e tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b" status: 200 len: 1681 microversion: 2.1 time: 0.157632 Aug 04 21:57:26.194055 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 567/1127] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:26 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:57:27.215719 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e4dc99d6-e750-45e1-86f0-78849f7c19ad tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:27.216430 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e4dc99d6-e750-45e1-86f0-78849f7c19ad tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:27.222821 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e4dc99d6-e750-45e1-86f0-78849f7c19ad tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:27.223296 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e4dc99d6-e750-45e1-86f0-78849f7c19ad tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:27.223724 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e4dc99d6-e750-45e1-86f0-78849f7c19ad tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:27.224416 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e4dc99d6-e750-45e1-86f0-78849f7c19ad tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:27.224862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e4dc99d6-e750-45e1-86f0-78849f7c19ad tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:27.225288 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e4dc99d6-e750-45e1-86f0-78849f7c19ad tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:27.357550 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-e4dc99d6-e750-45e1-86f0-78849f7c19ad tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:27.365345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e4dc99d6-e750-45e1-86f0-78849f7c19ad tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b" status: 200 len: 1681 microversion: 2.1 time: 0.153859 Aug 04 21:57:27.365917 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 561/1128] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:27 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:57:28.387508 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2757cfdd-e4da-40a0-90fc-dc0300f44cee tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:28.388123 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2757cfdd-e4da-40a0-90fc-dc0300f44cee tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:28.394601 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2757cfdd-e4da-40a0-90fc-dc0300f44cee tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:28.395080 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2757cfdd-e4da-40a0-90fc-dc0300f44cee tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:28.395516 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2757cfdd-e4da-40a0-90fc-dc0300f44cee tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:28.396203 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2757cfdd-e4da-40a0-90fc-dc0300f44cee tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:28.396652 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2757cfdd-e4da-40a0-90fc-dc0300f44cee tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:28.397080 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2757cfdd-e4da-40a0-90fc-dc0300f44cee tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:28.625365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2757cfdd-e4da-40a0-90fc-dc0300f44cee tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:28.633854 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2757cfdd-e4da-40a0-90fc-dc0300f44cee tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b" status: 200 len: 1681 microversion: 2.1 time: 0.250156 Aug 04 21:57:28.634455 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 568/1129] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:28 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b => generated 1681 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:57:29.181312 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-5168d69e-6790-4169-9165-28478ea11d40 req-bd97eecb-8ad5-4bf6-802a-49549a19d313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebeb1675-f6ec-4a67-98ce-901e1e4f839b", "name": "network-vif-deleted", "tag": "fdeca7a7-9d5f-418c-8dd4-09147d83bbee"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:57:29.193439 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-5168d69e-6790-4169-9165-28478ea11d40 req-bd97eecb-8ad5-4bf6-802a-49549a19d313 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:29.194336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-5168d69e-6790-4169-9165-28478ea11d40 req-bd97eecb-8ad5-4bf6-802a-49549a19d313 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:29.195018 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-5168d69e-6790-4169-9165-28478ea11d40 req-bd97eecb-8ad5-4bf6-802a-49549a19d313 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:29.208545 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-5168d69e-6790-4169-9165-28478ea11d40 req-bd97eecb-8ad5-4bf6-802a-49549a19d313 service nova] Creating event network-vif-deleted:fdeca7a7-9d5f-418c-8dd4-09147d83bbee for instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b on hv-cinder-85220 Aug 04 21:57:29.214382 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-5168d69e-6790-4169-9165-28478ea11d40 req-bd97eecb-8ad5-4bf6-802a-49549a19d313 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113511 Aug 04 21:57:29.218370 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 562/1130] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:57:29.655756 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a5704384-7c4e-46ec-be6e-f2151c2a13fb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:29.657168 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-a5704384-7c4e-46ec-be6e-f2151c2a13fb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:29.663872 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a5704384-7c4e-46ec-be6e-f2151c2a13fb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:29.664360 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a5704384-7c4e-46ec-be6e-f2151c2a13fb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:29.664792 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a5704384-7c4e-46ec-be6e-f2151c2a13fb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:29.665539 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a5704384-7c4e-46ec-be6e-f2151c2a13fb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:29.665988 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a5704384-7c4e-46ec-be6e-f2151c2a13fb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:29.666436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a5704384-7c4e-46ec-be6e-f2151c2a13fb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:29.697335 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a5704384-7c4e-46ec-be6e-f2151c2a13fb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:29.697812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a5704384-7c4e-46ec-be6e-f2151c2a13fb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:29.698270 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a5704384-7c4e-46ec-be6e-f2151c2a13fb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:29.698717 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-a5704384-7c4e-46ec-be6e-f2151c2a13fb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lazy-loading 'fault' on Instance uuid ebeb1675-f6ec-4a67-98ce-901e1e4f839b {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:57:29.742302 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-a5704384-7c4e-46ec-be6e-f2151c2a13fb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:29.750612 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-a5704384-7c4e-46ec-be6e-f2151c2a13fb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b" status: 200 len: 1332 microversion: 2.1 time: 0.099177 Aug 04 21:57:29.751194 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 569/1131] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:29 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:57:30.774124 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e609280f-f5b2-47a3-a14f-3594c7aa0a51 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:30.775421 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-e609280f-f5b2-47a3-a14f-3594c7aa0a51 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:30.782111 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e609280f-f5b2-47a3-a14f-3594c7aa0a51 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:30.782628 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e609280f-f5b2-47a3-a14f-3594c7aa0a51 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:30.783023 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e609280f-f5b2-47a3-a14f-3594c7aa0a51 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:30.783710 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e609280f-f5b2-47a3-a14f-3594c7aa0a51 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:30.784158 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e609280f-f5b2-47a3-a14f-3594c7aa0a51 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:30.784576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-e609280f-f5b2-47a3-a14f-3594c7aa0a51 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:30.798372 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-e609280f-f5b2-47a3-a14f-3594c7aa0a51 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] HTTP exception thrown: Instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b could not be found. Aug 04 21:57:30.800017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e609280f-f5b2-47a3-a14f-3594c7aa0a51 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Request method failure captured: Aug 04 21:57:30.800017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b HTTP/1.1 Aug 04 21:57:30.800017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:57:30.800017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:57:30.800017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:57:30.800017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 21:57:30.800017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:57:30.800017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:57:30.800017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:57:30.800017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:57:30.800017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7D9t8rsKG84MG-XeY6Nlc6oGUGTGzOn1qsEfIgp1-xWWIq9149YutAj8rytKzxl4OvY1D-ym8-Nqng1af7gQx4CCQV_83zm6k1TU_HYRQtFUyhCDmnq8eGjcIc6yEaD-_4bsQnyh21Y-tgkQxsJlI6-_LY5y9tnue57bh7Fq5uafa0U Aug 04 21:57:30.800017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:57:30.800017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:57:30.800017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:57:30.800017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:57:30.800017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:57:30.800017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:57:30.800017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:57:30.800017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:57:30.800017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:57:30.800017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:57:30.801647 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8c4ab3c7309249228e42c226277fb14f", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:57:30.801647 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:57:30.801647 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:57:30.801647 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:57:30.801647 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:57:30.801647 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:57:30.801647 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:57:30.801647 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: a022ce50f3334e919dcf0008bb6afcf8 Aug 04 21:57:30.801647 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:57:30.801647 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 21:57:30.801647 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b could not be found. Aug 04 21:57:30.801647 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': 'ebeb1675-f6ec-4a67-98ce-901e1e4f839b'} Aug 04 21:57:30.802790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:57:30.802790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:57:30.802790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:57:30.802790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:57:30.802790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:57:30.802790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:57:30.802790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:57:30.802790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:57:30.802790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:57:30.802790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:57:30.802790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b could not be found. Aug 04 21:57:30.802790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:57:30.802790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:57:30.802790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:57:30.802790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:57:30.802790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:57:30.802790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:57:30.802790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:57:30.802790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:57:30.802790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:57:30.804325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:57:30.804325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:57:30.804325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:57:30.804325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:57:30.804325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:57:30.804325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:57:30.804325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:57:30.804325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b could not be found. Aug 04 21:57:30.804325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:57:30.804325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:57:30.804325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:57:30.804325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:57:30.804325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:57:30.804325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:57:30.804325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:57:30.804325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:57:30.804325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b could not be found. Aug 04 21:57:30.804325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:57:30.806169 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e609280f-f5b2-47a3-a14f-3594c7aa0a51 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Returning 404 to user: Instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:57:30.806169 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e609280f-f5b2-47a3-a14f-3594c7aa0a51 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b" status: 404 len: 111 microversion: 2.1 time: 0.032195 Aug 04 21:57:30.806169 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 563/1132] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:30 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:57:30.810628 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-aa829e94-2deb-42f8-991c-7935d324c5f0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '.version_select at 0x7f3c14fe1790>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:30.880451 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-aa829e94-2deb-42f8-991c-7935d324c5f0 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2100646338" status: 202 len: 0 microversion: 2.1 time: 0.073744 Aug 04 21:57:30.881087 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 570/1133] 10.222.0.73 () {58 vars in 1221 bytes} [Thu Aug 4 21:57:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2100646338 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:57:31.577952 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ce20acf3-b730-44b7-b5a9-6c98804e743f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Action: 'create', calling method: .version_select at 0x7f3c107d8c10>, body: {"keypair": {"name": "tempest-keypair-523835242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMD/xgeeF1ZMAJW2vGQPFQenSAfTNQgzd0DQfRsFHtTY9NiOrKOIf+HLMyNuhq+u3uzRyY9SllMgWLAgtLZrKti2O2nX5Zx3+0NwTKlzROS9AN7NEIe2WFagZnrR7Zx/w=="}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:57:31.593346 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-ce20acf3-b730-44b7-b5a9-6c98804e743f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Getting quotas for project 8c4ab3c7309249228e42c226277fb14f. Resources: {'key_pairs'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:57:31.597213 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-ce20acf3-b730-44b7-b5a9-6c98804e743f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Getting quotas for user a022ce50f3334e919dcf0008bb6afcf8 and project 8c4ab3c7309249228e42c226277fb14f. Resources: {'key_pairs'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:57:31.703607 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ce20acf3-b730-44b7-b5a9-6c98804e743f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.129569 Aug 04 21:57:31.704231 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 564/1134] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 4 21:57:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:57:34.094137 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-306e7071-564e-437a-a47e-dd95c94c2928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-31911135", "imageRef": "fca0c9ba-fb0a-4f30-932f-84d5253674ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7a01edd-380d-4680-81ec-9f1437601985"}], "security_groups": [{"name": "tempest-securitygroup--1552456035"}], "key_name": "tempest-keypair-523835242", "user_data": "}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:57:34.202217 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.network.neutron [None req-306e7071-564e-437a-a47e-dd95c94c2928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] validate_networks() for [('f7a01edd-380d-4680-81ec-9f1437601985', None, None, None, None, None)] {{(pid=136342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:57:34.570445 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-306e7071-564e-437a-a47e-dd95c94c2928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Flavor limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:57:34.571570 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-306e7071-564e-437a-a47e-dd95c94c2928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Image limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:57:34.572050 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-306e7071-564e-437a-a47e-dd95c94c2928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Flavor pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:57:34.572451 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-306e7071-564e-437a-a47e-dd95c94c2928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Image pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:57:34.572854 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-306e7071-564e-437a-a47e-dd95c94c2928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:57:34.581520 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-306e7071-564e-437a-a47e-dd95c94c2928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:34.581994 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-306e7071-564e-437a-a47e-dd95c94c2928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:34.582448 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-306e7071-564e-437a-a47e-dd95c94c2928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:34.583159 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-306e7071-564e-437a-a47e-dd95c94c2928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:34.583606 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-306e7071-564e-437a-a47e-dd95c94c2928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:34.584021 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-306e7071-564e-437a-a47e-dd95c94c2928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:34.601063 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-306e7071-564e-437a-a47e-dd95c94c2928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Getting quotas for project 8c4ab3c7309249228e42c226277fb14f. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:57:34.605155 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-306e7071-564e-437a-a47e-dd95c94c2928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Getting quotas for user a022ce50f3334e919dcf0008bb6afcf8 and project 8c4ab3c7309249228e42c226277fb14f. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:57:34.615786 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-306e7071-564e-437a-a47e-dd95c94c2928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Going to run 1 instances... {{(pid=136342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:57:34.618630 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-306e7071-564e-437a-a47e-dd95c94c2928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca0c9ba-fb0a-4f30-932f-84d5253674ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:57:34.783846 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-306e7071-564e-437a-a47e-dd95c94c2928 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.694424 Aug 04 21:57:34.784519 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 571/1135] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 4 21:57:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 21:57:34.796586 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2d4d5411-04c1-4f7d-91d5-d002bd1abdac tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:34.797192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-2d4d5411-04c1-4f7d-91d5-d002bd1abdac tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:34.854777 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2d4d5411-04c1-4f7d-91d5-d002bd1abdac tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:34.861623 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2d4d5411-04c1-4f7d-91d5-d002bd1abdac tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502" status: 200 len: 1239 microversion: 2.1 time: 0.069546 Aug 04 21:57:34.862216 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 565/1136] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:34 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:57:35.884358 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4a5b29b0-a456-4396-badc-d4b95dcc964d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:35.885254 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4a5b29b0-a456-4396-badc-d4b95dcc964d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:35.891216 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4a5b29b0-a456-4396-badc-d4b95dcc964d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:35.891697 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4a5b29b0-a456-4396-badc-d4b95dcc964d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:35.892130 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4a5b29b0-a456-4396-badc-d4b95dcc964d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:35.892927 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4a5b29b0-a456-4396-badc-d4b95dcc964d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:35.893321 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4a5b29b0-a456-4396-badc-d4b95dcc964d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:35.893896 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4a5b29b0-a456-4396-badc-d4b95dcc964d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:35.957534 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4a5b29b0-a456-4396-badc-d4b95dcc964d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:35.965333 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4a5b29b0-a456-4396-badc-d4b95dcc964d tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502" status: 200 len: 1243 microversion: 2.1 time: 0.086190 Aug 04 21:57:35.968352 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 572/1137] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:35 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 => generated 1243 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:57:36.986651 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-6cc3821f-903b-4e66-9243-b087a7fc1b61 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:36.987268 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-6cc3821f-903b-4e66-9243-b087a7fc1b61 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:36.994595 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6cc3821f-903b-4e66-9243-b087a7fc1b61 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:36.995198 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6cc3821f-903b-4e66-9243-b087a7fc1b61 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:36.995634 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6cc3821f-903b-4e66-9243-b087a7fc1b61 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:36.996324 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6cc3821f-903b-4e66-9243-b087a7fc1b61 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:36.996765 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6cc3821f-903b-4e66-9243-b087a7fc1b61 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:36.997183 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6cc3821f-903b-4e66-9243-b087a7fc1b61 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:37.063308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6cc3821f-903b-4e66-9243-b087a7fc1b61 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:37.075340 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-6cc3821f-903b-4e66-9243-b087a7fc1b61 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502" status: 200 len: 1297 microversion: 2.1 time: 0.088648 Aug 04 21:57:37.075340 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 566/1138] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:36 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:57:38.093918 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-86aec4e2-a5fc-4a38-96e6-8543409c0069 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:38.094636 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-86aec4e2-a5fc-4a38-96e6-8543409c0069 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:38.101476 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-86aec4e2-a5fc-4a38-96e6-8543409c0069 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:38.106713 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-86aec4e2-a5fc-4a38-96e6-8543409c0069 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:38.107579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-86aec4e2-a5fc-4a38-96e6-8543409c0069 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:38.108438 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-86aec4e2-a5fc-4a38-96e6-8543409c0069 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:38.109532 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-86aec4e2-a5fc-4a38-96e6-8543409c0069 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:38.110075 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-86aec4e2-a5fc-4a38-96e6-8543409c0069 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:38.348271 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-86aec4e2-a5fc-4a38-96e6-8543409c0069 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:38.356778 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-86aec4e2-a5fc-4a38-96e6-8543409c0069 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502" status: 200 len: 1365 microversion: 2.1 time: 0.267091 Aug 04 21:57:38.357273 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 573/1139] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:38 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:57:38.543819 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-335fa576-496b-48e0-b227-9225de32f67a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:38.544706 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-335fa576-496b-48e0-b227-9225de32f67a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:38.545493 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-e8102313-d8fb-4df4-b57a-a67237d66105 req-c2ec318e-c3df-45e6-9093-f6e956591ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028c5cd4-1e11-4bde-8f66-4fdf8ef236fd", "tag": "76694182-b548-439d-b9e0-08a5f1cbd3f7"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:57:38.552890 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-335fa576-496b-48e0-b227-9225de32f67a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:38.553513 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-335fa576-496b-48e0-b227-9225de32f67a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:38.554242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-335fa576-496b-48e0-b227-9225de32f67a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:38.555884 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-335fa576-496b-48e0-b227-9225de32f67a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:38.556662 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-335fa576-496b-48e0-b227-9225de32f67a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:38.557262 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-335fa576-496b-48e0-b227-9225de32f67a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:38.558401 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-e8102313-d8fb-4df4-b57a-a67237d66105 req-c2ec318e-c3df-45e6-9093-f6e956591ba6 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:38.561349 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-e8102313-d8fb-4df4-b57a-a67237d66105 req-c2ec318e-c3df-45e6-9093-f6e956591ba6 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:38.561800 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-e8102313-d8fb-4df4-b57a-a67237d66105 req-c2ec318e-c3df-45e6-9093-f6e956591ba6 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:38.580346 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-e8102313-d8fb-4df4-b57a-a67237d66105 req-c2ec318e-c3df-45e6-9093-f6e956591ba6 service nova] Creating event network-changed:76694182-b548-439d-b9e0-08a5f1cbd3f7 for instance 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd on hv-cinder-85220 Aug 04 21:57:38.585558 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-e8102313-d8fb-4df4-b57a-a67237d66105 req-c2ec318e-c3df-45e6-9093-f6e956591ba6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043480 Aug 04 21:57:38.586624 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-335fa576-496b-48e0-b227-9225de32f67a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Going to try to terminate instance {{(pid=136341) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:57:38.586808 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 574/1140] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:57:38.772398 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-dbb02c5b-4ce1-415a-b810-9dd0f858e825 req-5b219c2b-26de-46ef-9163-bdaf8adcd8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a202369-bdc9-47b0-b879-3e004088e502", "tag": "339a85bf-dea4-4876-9134-03c437159fea"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:57:38.784343 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-dbb02c5b-4ce1-415a-b810-9dd0f858e825 req-5b219c2b-26de-46ef-9163-bdaf8adcd8a6 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:38.785298 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-dbb02c5b-4ce1-415a-b810-9dd0f858e825 req-5b219c2b-26de-46ef-9163-bdaf8adcd8a6 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:38.785742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-dbb02c5b-4ce1-415a-b810-9dd0f858e825 req-5b219c2b-26de-46ef-9163-bdaf8adcd8a6 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:38.797742 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-dbb02c5b-4ce1-415a-b810-9dd0f858e825 req-5b219c2b-26de-46ef-9163-bdaf8adcd8a6 service nova] Creating event network-changed:339a85bf-dea4-4876-9134-03c437159fea for instance 5a202369-bdc9-47b0-b879-3e004088e502 on hv-cinder-85220 Aug 04 21:57:38.803762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-dbb02c5b-4ce1-415a-b810-9dd0f858e825 req-5b219c2b-26de-46ef-9163-bdaf8adcd8a6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035367 Aug 04 21:57:38.804557 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 575/1141] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:57:38.957094 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-335fa576-496b-48e0-b227-9225de32f67a tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "DELETE /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 204 len: 0 microversion: 2.1 time: 0.419092 Aug 04 21:57:38.957678 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 567/1142] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:57:38 2022] DELETE /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:57:38.967255 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-56cc5c4b-3cba-44dd-ad54-dda1defaf087 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:38.968147 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-56cc5c4b-3cba-44dd-ad54-dda1defaf087 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:38.974555 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-56cc5c4b-3cba-44dd-ad54-dda1defaf087 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:38.975116 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-56cc5c4b-3cba-44dd-ad54-dda1defaf087 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:38.975623 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-56cc5c4b-3cba-44dd-ad54-dda1defaf087 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:38.976395 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-56cc5c4b-3cba-44dd-ad54-dda1defaf087 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:38.977739 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-56cc5c4b-3cba-44dd-ad54-dda1defaf087 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:38.978550 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-56cc5c4b-3cba-44dd-ad54-dda1defaf087 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:39.116845 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-56cc5c4b-3cba-44dd-ad54-dda1defaf087 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:39.124916 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-56cc5c4b-3cba-44dd-ad54-dda1defaf087 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1570 microversion: 2.1 time: 0.161968 Aug 04 21:57:39.125490 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 576/1143] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:38 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:57:39.378912 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b634e1f4-a6c8-468f-b2fa-5d02d6fab7cb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:39.379611 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b634e1f4-a6c8-468f-b2fa-5d02d6fab7cb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:39.386258 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b634e1f4-a6c8-468f-b2fa-5d02d6fab7cb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:39.386753 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b634e1f4-a6c8-468f-b2fa-5d02d6fab7cb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:39.387384 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b634e1f4-a6c8-468f-b2fa-5d02d6fab7cb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:39.388089 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b634e1f4-a6c8-468f-b2fa-5d02d6fab7cb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:39.388531 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b634e1f4-a6c8-468f-b2fa-5d02d6fab7cb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:39.388942 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b634e1f4-a6c8-468f-b2fa-5d02d6fab7cb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:39.535324 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b634e1f4-a6c8-468f-b2fa-5d02d6fab7cb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:39.544206 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b634e1f4-a6c8-468f-b2fa-5d02d6fab7cb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502" status: 200 len: 1365 microversion: 2.1 time: 0.169682 Aug 04 21:57:39.544891 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 568/1144] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:39 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:57:40.147911 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e0a924a1-e6b1-46fa-9fe2-a8638fa556ac tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:40.148908 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e0a924a1-e6b1-46fa-9fe2-a8638fa556ac tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:40.155299 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e0a924a1-e6b1-46fa-9fe2-a8638fa556ac tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:40.156011 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e0a924a1-e6b1-46fa-9fe2-a8638fa556ac tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:40.156858 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e0a924a1-e6b1-46fa-9fe2-a8638fa556ac tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:40.158028 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e0a924a1-e6b1-46fa-9fe2-a8638fa556ac tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:40.158976 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e0a924a1-e6b1-46fa-9fe2-a8638fa556ac tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:40.159672 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e0a924a1-e6b1-46fa-9fe2-a8638fa556ac tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:40.325472 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-e0a924a1-e6b1-46fa-9fe2-a8638fa556ac tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:40.333400 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e0a924a1-e6b1-46fa-9fe2-a8638fa556ac tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1570 microversion: 2.1 time: 0.190494 Aug 04 21:57:40.333975 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 577/1145] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:40 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1570 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:57:40.565657 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-5fb6e9b5-c483-4b5b-a294-706cc2c426c1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:40.566306 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-5fb6e9b5-c483-4b5b-a294-706cc2c426c1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:40.572712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5fb6e9b5-c483-4b5b-a294-706cc2c426c1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:40.573261 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5fb6e9b5-c483-4b5b-a294-706cc2c426c1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:40.573612 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5fb6e9b5-c483-4b5b-a294-706cc2c426c1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:40.574340 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5fb6e9b5-c483-4b5b-a294-706cc2c426c1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:40.574842 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5fb6e9b5-c483-4b5b-a294-706cc2c426c1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:40.575181 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5fb6e9b5-c483-4b5b-a294-706cc2c426c1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:40.736803 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5fb6e9b5-c483-4b5b-a294-706cc2c426c1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:40.747912 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-5fb6e9b5-c483-4b5b-a294-706cc2c426c1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502" status: 200 len: 1365 microversion: 2.1 time: 0.185591 Aug 04 21:57:40.748587 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 569/1146] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:40 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:57:41.343242 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-40bc2807-1748-46c4-8085-e71c2f6cfcf7 req-fb589d01-b52e-468e-b6ea-7e17901941fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028c5cd4-1e11-4bde-8f66-4fdf8ef236fd", "name": "network-vif-deleted", "tag": "76694182-b548-439d-b9e0-08a5f1cbd3f7"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:57:41.353411 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-40bc2807-1748-46c4-8085-e71c2f6cfcf7 req-fb589d01-b52e-468e-b6ea-7e17901941fe service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:41.353821 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-40bc2807-1748-46c4-8085-e71c2f6cfcf7 req-fb589d01-b52e-468e-b6ea-7e17901941fe service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:41.354343 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-40bc2807-1748-46c4-8085-e71c2f6cfcf7 req-fb589d01-b52e-468e-b6ea-7e17901941fe service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:41.357615 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-114075e0-efc4-4956-8e69-949e1eff1909 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:41.358252 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-114075e0-efc4-4956-8e69-949e1eff1909 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:41.364160 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-114075e0-efc4-4956-8e69-949e1eff1909 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:41.364633 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-114075e0-efc4-4956-8e69-949e1eff1909 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:41.365054 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-114075e0-efc4-4956-8e69-949e1eff1909 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:41.365735 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-114075e0-efc4-4956-8e69-949e1eff1909 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:41.366210 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-114075e0-efc4-4956-8e69-949e1eff1909 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:41.366630 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-114075e0-efc4-4956-8e69-949e1eff1909 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:41.367118 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-40bc2807-1748-46c4-8085-e71c2f6cfcf7 req-fb589d01-b52e-468e-b6ea-7e17901941fe service nova] Creating event network-vif-deleted:76694182-b548-439d-b9e0-08a5f1cbd3f7 for instance 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd on hv-cinder-85220 Aug 04 21:57:41.373136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-40bc2807-1748-46c4-8085-e71c2f6cfcf7 req-fb589d01-b52e-468e-b6ea-7e17901941fe service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033335 Aug 04 21:57:41.373735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 578/1147] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:57:41.436791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-114075e0-efc4-4956-8e69-949e1eff1909 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:41.444806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-114075e0-efc4-4956-8e69-949e1eff1909 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1383 microversion: 2.1 time: 0.091623 Aug 04 21:57:41.445387 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 570/1148] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:41 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1383 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:57:41.782304 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-25949541-d26c-4774-91c4-3d67800b8810 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:41.783003 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-25949541-d26c-4774-91c4-3d67800b8810 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:41.790164 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-25949541-d26c-4774-91c4-3d67800b8810 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:41.790657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-25949541-d26c-4774-91c4-3d67800b8810 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:41.791087 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-25949541-d26c-4774-91c4-3d67800b8810 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:41.791792 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-25949541-d26c-4774-91c4-3d67800b8810 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:41.792240 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-25949541-d26c-4774-91c4-3d67800b8810 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:41.792657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-25949541-d26c-4774-91c4-3d67800b8810 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:41.928954 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-25949541-d26c-4774-91c4-3d67800b8810 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:41.936420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-25949541-d26c-4774-91c4-3d67800b8810 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502" status: 200 len: 1365 microversion: 2.1 time: 0.158526 Aug 04 21:57:41.936979 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 579/1149] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:41 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:57:42.466778 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-50c6383b-45bc-4690-9d13-63e57993fd8b tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:42.467474 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-50c6383b-45bc-4690-9d13-63e57993fd8b tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:42.474601 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-50c6383b-45bc-4690-9d13-63e57993fd8b tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:42.475073 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-50c6383b-45bc-4690-9d13-63e57993fd8b tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:42.475497 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-50c6383b-45bc-4690-9d13-63e57993fd8b tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:42.476176 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-50c6383b-45bc-4690-9d13-63e57993fd8b tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:42.476620 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-50c6383b-45bc-4690-9d13-63e57993fd8b tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:42.477538 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-50c6383b-45bc-4690-9d13-63e57993fd8b tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:42.496014 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:57:42.540947 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-50c6383b-45bc-4690-9d13-63e57993fd8b tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:42.548923 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-50c6383b-45bc-4690-9d13-63e57993fd8b tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1383 microversion: 2.1 time: 0.086201 Aug 04 21:57:42.549505 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 571/1150] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:42 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1383 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:57:42.956688 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-3d12a19b-0086-4cdb-9bea-1053582042f5 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:42.957299 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-3d12a19b-0086-4cdb-9bea-1053582042f5 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:42.963680 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d12a19b-0086-4cdb-9bea-1053582042f5 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:42.964227 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d12a19b-0086-4cdb-9bea-1053582042f5 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:42.964596 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d12a19b-0086-4cdb-9bea-1053582042f5 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:42.965281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d12a19b-0086-4cdb-9bea-1053582042f5 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:42.965732 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d12a19b-0086-4cdb-9bea-1053582042f5 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:42.966192 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3d12a19b-0086-4cdb-9bea-1053582042f5 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:43.097144 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-3d12a19b-0086-4cdb-9bea-1053582042f5 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:43.105072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-3d12a19b-0086-4cdb-9bea-1053582042f5 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502" status: 200 len: 1365 microversion: 2.1 time: 0.152225 Aug 04 21:57:43.105626 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 580/1151] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:42 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:57:43.570413 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-39198baa-c157-4619-a0ca-577fea3480ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:43.571041 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-39198baa-c157-4619-a0ca-577fea3480ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:43.578516 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-39198baa-c157-4619-a0ca-577fea3480ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:43.579005 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-39198baa-c157-4619-a0ca-577fea3480ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:43.579444 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-39198baa-c157-4619-a0ca-577fea3480ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:43.580194 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-39198baa-c157-4619-a0ca-577fea3480ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:43.580806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-39198baa-c157-4619-a0ca-577fea3480ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:43.581238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-39198baa-c157-4619-a0ca-577fea3480ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:43.651260 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-39198baa-c157-4619-a0ca-577fea3480ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:43.658847 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-39198baa-c157-4619-a0ca-577fea3480ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1219 microversion: 2.1 time: 0.092779 Aug 04 21:57:43.659397 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 572/1152] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:43 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:57:44.126610 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-37695b9e-17f2-4280-b9b1-e26ce6b766ea tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:44.127226 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-37695b9e-17f2-4280-b9b1-e26ce6b766ea tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:44.133609 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-37695b9e-17f2-4280-b9b1-e26ce6b766ea tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:44.134236 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-37695b9e-17f2-4280-b9b1-e26ce6b766ea tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:44.135454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-37695b9e-17f2-4280-b9b1-e26ce6b766ea tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:44.136158 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-37695b9e-17f2-4280-b9b1-e26ce6b766ea tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:44.136626 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-37695b9e-17f2-4280-b9b1-e26ce6b766ea tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:44.137035 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-37695b9e-17f2-4280-b9b1-e26ce6b766ea tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:44.272277 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-37695b9e-17f2-4280-b9b1-e26ce6b766ea tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:44.280110 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-37695b9e-17f2-4280-b9b1-e26ce6b766ea tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502" status: 200 len: 1365 microversion: 2.1 time: 0.157692 Aug 04 21:57:44.280728 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 581/1153] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:44 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:57:44.679456 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f8b02d82-7ce9-4b4b-a8d3-3994fb1b9767 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:44.680062 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-f8b02d82-7ce9-4b4b-a8d3-3994fb1b9767 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:44.682412 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:57:44.687800 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f8b02d82-7ce9-4b4b-a8d3-3994fb1b9767 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:44.688260 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f8b02d82-7ce9-4b4b-a8d3-3994fb1b9767 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:44.688694 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f8b02d82-7ce9-4b4b-a8d3-3994fb1b9767 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:44.689384 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f8b02d82-7ce9-4b4b-a8d3-3994fb1b9767 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:44.690038 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f8b02d82-7ce9-4b4b-a8d3-3994fb1b9767 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:44.690462 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f8b02d82-7ce9-4b4b-a8d3-3994fb1b9767 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:44.723254 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f8b02d82-7ce9-4b4b-a8d3-3994fb1b9767 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:44.724689 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f8b02d82-7ce9-4b4b-a8d3-3994fb1b9767 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:44.724689 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f8b02d82-7ce9-4b4b-a8d3-3994fb1b9767 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:44.724689 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.objects.instance [None req-f8b02d82-7ce9-4b4b-a8d3-3994fb1b9767 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lazy-loading 'fault' on Instance uuid 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd {{(pid=136341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:57:44.767427 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f8b02d82-7ce9-4b4b-a8d3-3994fb1b9767 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38358c71d0eb4d63a008925b18e68adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7cf7a2010f419688871e4c9469084d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:44.775097 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f8b02d82-7ce9-4b4b-a8d3-3994fb1b9767 tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 200 len: 1224 microversion: 2.1 time: 0.099920 Aug 04 21:57:44.775697 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 573/1154] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:44 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:57:44.830248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-495bb881-43e6-4eea-a804-436152d92094 req-115e0aff-f5a0-4f39-bcd9-4f3787bdf743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a202369-bdc9-47b0-b879-3e004088e502", "name": "network-vif-plugged", "status": "completed", "tag": "339a85bf-dea4-4876-9134-03c437159fea"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:57:44.835260 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=2 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:57:44.835915 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=6 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:57:44.841932 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-495bb881-43e6-4eea-a804-436152d92094 req-115e0aff-f5a0-4f39-bcd9-4f3787bdf743 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:44.842444 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-495bb881-43e6-4eea-a804-436152d92094 req-115e0aff-f5a0-4f39-bcd9-4f3787bdf743 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:44.842898 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-495bb881-43e6-4eea-a804-436152d92094 req-115e0aff-f5a0-4f39-bcd9-4f3787bdf743 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:44.854142 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-495bb881-43e6-4eea-a804-436152d92094 req-115e0aff-f5a0-4f39-bcd9-4f3787bdf743 service nova] Creating event network-vif-plugged:339a85bf-dea4-4876-9134-03c437159fea for instance 5a202369-bdc9-47b0-b879-3e004088e502 on hv-cinder-85220 Aug 04 21:57:44.859891 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-495bb881-43e6-4eea-a804-436152d92094 req-115e0aff-f5a0-4f39-bcd9-4f3787bdf743 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033311 Aug 04 21:57:44.860493 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 582/1155] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:57:45.301295 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f5e40b63-2e70-4a14-85df-1b39a4606697 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:45.301936 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-f5e40b63-2e70-4a14-85df-1b39a4606697 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:45.304238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=6 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:57:45.309470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f5e40b63-2e70-4a14-85df-1b39a4606697 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:45.309950 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f5e40b63-2e70-4a14-85df-1b39a4606697 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:45.310442 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f5e40b63-2e70-4a14-85df-1b39a4606697 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:45.311162 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f5e40b63-2e70-4a14-85df-1b39a4606697 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:45.311600 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f5e40b63-2e70-4a14-85df-1b39a4606697 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:45.312012 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f5e40b63-2e70-4a14-85df-1b39a4606697 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:45.453149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f5e40b63-2e70-4a14-85df-1b39a4606697 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:45.461019 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f5e40b63-2e70-4a14-85df-1b39a4606697 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502" status: 200 len: 1365 microversion: 2.1 time: 0.163926 Aug 04 21:57:45.461578 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 574/1156] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:45 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:57:45.798459 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-464229a0-6c4f-4d75-bcd4-2efac1c556ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:45.799164 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-464229a0-6c4f-4d75-bcd4-2efac1c556ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] [instance: 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:45.805957 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-464229a0-6c4f-4d75-bcd4-2efac1c556ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:45.806462 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-464229a0-6c4f-4d75-bcd4-2efac1c556ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:45.806891 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-464229a0-6c4f-4d75-bcd4-2efac1c556ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:45.807612 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-464229a0-6c4f-4d75-bcd4-2efac1c556ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:45.808057 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-464229a0-6c4f-4d75-bcd4-2efac1c556ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:45.808473 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-464229a0-6c4f-4d75-bcd4-2efac1c556ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:45.821909 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-464229a0-6c4f-4d75-bcd4-2efac1c556ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] HTTP exception thrown: Instance 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd could not be found. Aug 04 21:57:45.823579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-464229a0-6c4f-4d75-bcd4-2efac1c556ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Request method failure captured: Aug 04 21:57:45.823579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd HTTP/1.1 Aug 04 21:57:45.823579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:57:45.823579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:57:45.823579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:57:45.823579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:57:45.823579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:57:45.823579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:57:45.823579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:57:45.823579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:57:45.823579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7D-MwVpCAzYYmBbGjZHiAlzvNkR_ESr8Th_S13k9bjtHHBrpmTPVGSO0AB6VR5t41wmisap5e1zw08XYi6ZbZX_01gUnntOq-1COqwgIOO7zR_8JiSm6gezL6BfXR7tZOKG4wFq8M_Uxcdjo0kRBOYVp5rfzzX4G9D7wruEt-v8NK4w Aug 04 21:57:45.823579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:57:45.823579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:57:45.823579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:57:45.823579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:57:45.823579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:57:45.823579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:57:45.823579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: bd7cf7a2010f419688871e4c9469084d Aug 04 21:57:45.823579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-TestShelveInstance-1865916990 Aug 04 21:57:45.823579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:57:45.823579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:57:45.825641 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_bd7cf7a2010f419688871e4c9469084d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/bd7cf7a2010f419688871e4c9469084d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bd7cf7a2010f419688871e4c9469084d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bd7cf7a2010f419688871e4c9469084d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:57:45.825641 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-TestShelveInstance-1865916990 Aug 04 21:57:45.825641 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: bd7cf7a2010f419688871e4c9469084d Aug 04 21:57:45.825641 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-TestShelveInstance-1865916990 Aug 04 21:57:45.825641 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-TestShelveInstance-1865916990-project Aug 04 21:57:45.825641 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:57:45.825641 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:57:45.825641 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: 38358c71d0eb4d63a008925b18e68adb Aug 04 21:57:45.825641 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-TestShelveInstance-1865916990-project Aug 04 21:57:45.825641 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:57:45.825641 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd could not be found. Aug 04 21:57:45.825641 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': '028c5cd4-1e11-4bde-8f66-4fdf8ef236fd'} Aug 04 21:57:45.828409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:57:45.828409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:57:45.828409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:57:45.828409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:57:45.828409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:57:45.828409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:57:45.828409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:57:45.828409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:57:45.828409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:57:45.828409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:57:45.828409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd could not be found. Aug 04 21:57:45.828409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:57:45.828409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:57:45.828409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:57:45.828409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:57:45.828409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:57:45.828409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:57:45.828409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:57:45.828409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:57:45.828409 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:57:45.829882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:57:45.829882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:57:45.829882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:57:45.829882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:57:45.829882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:57:45.829882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:57:45.829882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:57:45.829882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd could not be found. Aug 04 21:57:45.829882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:57:45.829882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:57:45.829882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:57:45.829882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:57:45.829882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:57:45.829882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:57:45.829882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:57:45.829882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:57:45.829882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd could not be found. Aug 04 21:57:45.829882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:57:45.831248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-464229a0-6c4f-4d75-bcd4-2efac1c556ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Returning 404 to user: Instance 028c5cd4-1e11-4bde-8f66-4fdf8ef236fd could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:57:45.831248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-464229a0-6c4f-4d75-bcd4-2efac1c556ec tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd" status: 404 len: 111 microversion: 2.1 time: 0.032396 Aug 04 21:57:45.831248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 583/1157] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:45 2022] GET /compute/v2.1/servers/028c5cd4-1e11-4bde-8f66-4fdf8ef236fd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:57:46.121987 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-4d952101-4d0c-4a34-b6bf-443afd22ebef tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] Calling method '.version_select at 0x7f3c107caa60>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:46.222926 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-4d952101-4d0c-4a34-b6bf-443afd22ebef tempest-TestShelveInstance-1865916990 tempest-TestShelveInstance-1865916990-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-460637521" status: 202 len: 0 microversion: 2.1 time: 0.104807 Aug 04 21:57:46.223726 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 575/1158] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 4 21:57:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-460637521 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 21:57:46.482453 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ad7c408a-1725-44e0-ae74-01279271cbf6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:46.483054 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ad7c408a-1725-44e0-ae74-01279271cbf6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:46.489422 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ad7c408a-1725-44e0-ae74-01279271cbf6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:46.489909 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ad7c408a-1725-44e0-ae74-01279271cbf6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:46.490371 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ad7c408a-1725-44e0-ae74-01279271cbf6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:46.491076 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ad7c408a-1725-44e0-ae74-01279271cbf6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:46.491533 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ad7c408a-1725-44e0-ae74-01279271cbf6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:46.491960 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ad7c408a-1725-44e0-ae74-01279271cbf6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:46.689186 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ad7c408a-1725-44e0-ae74-01279271cbf6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:46.696919 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ad7c408a-1725-44e0-ae74-01279271cbf6 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502" status: 200 len: 1365 microversion: 2.1 time: 0.218985 Aug 04 21:57:46.697735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 584/1159] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:46 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:57:47.720019 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-fc07e513-61f7-45c0-8aef-8c7c7e0cc1af tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:47.721067 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-fc07e513-61f7-45c0-8aef-8c7c7e0cc1af tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:47.740041 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fc07e513-61f7-45c0-8aef-8c7c7e0cc1af tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:47.740705 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fc07e513-61f7-45c0-8aef-8c7c7e0cc1af tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:47.742388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fc07e513-61f7-45c0-8aef-8c7c7e0cc1af tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:47.742388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fc07e513-61f7-45c0-8aef-8c7c7e0cc1af tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:47.742674 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fc07e513-61f7-45c0-8aef-8c7c7e0cc1af tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:47.742971 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-fc07e513-61f7-45c0-8aef-8c7c7e0cc1af tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:47.887831 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-fc07e513-61f7-45c0-8aef-8c7c7e0cc1af tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:57:47.896010 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-fc07e513-61f7-45c0-8aef-8c7c7e0cc1af tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502" status: 200 len: 1555 microversion: 2.1 time: 0.181055 Aug 04 21:57:47.896844 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 576/1160] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:57:47 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 => generated 1555 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:57:47.917499 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-e7aaccb9-7629-45fe-afed-a4c6cbe1f3a5 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:57:47.923811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-e7aaccb9-7629-45fe-afed-a4c6cbe1f3a5 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:57:47.925330 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e7aaccb9-7629-45fe-afed-a4c6cbe1f3a5 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:47.925812 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e7aaccb9-7629-45fe-afed-a4c6cbe1f3a5 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:47.926263 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e7aaccb9-7629-45fe-afed-a4c6cbe1f3a5 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:47.926950 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e7aaccb9-7629-45fe-afed-a4c6cbe1f3a5 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:47.927399 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e7aaccb9-7629-45fe-afed-a4c6cbe1f3a5 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:47.927818 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-e7aaccb9-7629-45fe-afed-a4c6cbe1f3a5 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:47.931716 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=100 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:57:48.058836 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-e7aaccb9-7629-45fe-afed-a4c6cbe1f3a5 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.145263 Aug 04 21:57:48.059546 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 585/1161] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 4 21:57:47 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:57:49.180350 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-bc181280-b850-4240-9598-b1c2f3d316a4 req-92614a03-131b-433e-a0e8-dec25690bbc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a202369-bdc9-47b0-b879-3e004088e502", "tag": "339a85bf-dea4-4876-9134-03c437159fea"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:57:49.192005 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-bc181280-b850-4240-9598-b1c2f3d316a4 req-92614a03-131b-433e-a0e8-dec25690bbc8 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:57:49.193665 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-bc181280-b850-4240-9598-b1c2f3d316a4 req-92614a03-131b-433e-a0e8-dec25690bbc8 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:57:49.193665 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-bc181280-b850-4240-9598-b1c2f3d316a4 req-92614a03-131b-433e-a0e8-dec25690bbc8 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:57:49.205681 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-bc181280-b850-4240-9598-b1c2f3d316a4 req-92614a03-131b-433e-a0e8-dec25690bbc8 service nova] Creating event network-changed:339a85bf-dea4-4876-9134-03c437159fea for instance 5a202369-bdc9-47b0-b879-3e004088e502 on hv-cinder-85220 Aug 04 21:57:49.211101 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-bc181280-b850-4240-9598-b1c2f3d316a4 req-92614a03-131b-433e-a0e8-dec25690bbc8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034455 Aug 04 21:57:49.211899 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 577/1162] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:58:09.736775 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:58:09.737976 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=2 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:58:09.956719 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-062a6b30-0c85-4f1f-af79-d8e5f8f9a7dc tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Action: 'create', calling method: .version_select at 0x7f3c14fe1ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1795731597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjBdw5HiOu27ocp2HKXy7QSCx9TT8hMbr2+a95z7B0uLnOSR5b3JCCRGik1e1KvHta5bg5qA4L2rM6uHhkvNOUSYyLIKEYsfGdPdcBdB5JKpI25aq8SDGfI/a7lM+mh4A=="}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:58:09.975612 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-062a6b30-0c85-4f1f-af79-d8e5f8f9a7dc tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Getting quotas for project ee8894a750724fb987a01514be0ab39b. Resources: {'key_pairs'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:58:09.980530 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-062a6b30-0c85-4f1f-af79-d8e5f8f9a7dc tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Getting quotas for user 292eee6c79214436962643db0a840708 and project ee8894a750724fb987a01514be0ab39b. Resources: {'key_pairs'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:58:10.075020 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-062a6b30-0c85-4f1f-af79-d8e5f8f9a7dc tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.339676 Aug 04 21:58:10.075884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 586/1163] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 4 21:58:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:58:35.706580 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-41169a6f-4a99-4d1b-a79b-76e841e2c992 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2098994700", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1795731597", "security_groups": [{"name": "tempest-secgroup-smoke-965852390"}], "block_device_mapping_v2": [{"uuid": "24341af6-3dce-4121-887b-30657fab8e55", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4dc06773-9775-4bb6-a3f2-6c12854b5693"}]}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:58:35.717032 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:58:35.717784 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=30 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:58:35.825154 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.network.neutron [None req-41169a6f-4a99-4d1b-a79b-76e841e2c992 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] validate_networks() for [('4dc06773-9775-4bb6-a3f2-6c12854b5693', None, None, None, None, None)] {{(pid=136341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:58:36.316352 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-41169a6f-4a99-4d1b-a79b-76e841e2c992 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Flavor limits 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:58:36.316768 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-41169a6f-4a99-4d1b-a79b-76e841e2c992 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Image limits 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:58:36.317232 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-41169a6f-4a99-4d1b-a79b-76e841e2c992 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Flavor pref 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:58:36.317628 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-41169a6f-4a99-4d1b-a79b-76e841e2c992 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Image pref 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:58:36.318047 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-41169a6f-4a99-4d1b-a79b-76e841e2c992 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:58:36.326646 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-41169a6f-4a99-4d1b-a79b-76e841e2c992 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:36.327112 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-41169a6f-4a99-4d1b-a79b-76e841e2c992 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:36.327536 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-41169a6f-4a99-4d1b-a79b-76e841e2c992 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:36.328242 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-41169a6f-4a99-4d1b-a79b-76e841e2c992 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:36.328681 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-41169a6f-4a99-4d1b-a79b-76e841e2c992 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:36.329092 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-41169a6f-4a99-4d1b-a79b-76e841e2c992 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:36.346355 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-41169a6f-4a99-4d1b-a79b-76e841e2c992 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Getting quotas for project ee8894a750724fb987a01514be0ab39b. Resources: {'instances', 'cores', 'ram'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:58:36.350271 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-41169a6f-4a99-4d1b-a79b-76e841e2c992 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Getting quotas for user 292eee6c79214436962643db0a840708 and project ee8894a750724fb987a01514be0ab39b. Resources: {'instances', 'cores', 'ram'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:58:36.406691 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-41169a6f-4a99-4d1b-a79b-76e841e2c992 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Going to run 1 instances... {{(pid=136341) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:58:36.409660 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-41169a6f-4a99-4d1b-a79b-76e841e2c992 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24341af6-3dce-4121-887b-30657fab8e55',volume_size=None,volume_type=None)] {{(pid=136341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:58:36.805578 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR oslo.messaging._drivers.impl_rabbit [None req-41169a6f-4a99-4d1b-a79b-76e841e2c992 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [8230e8fe-88a1-43db-96a0-98df2b370c2f] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 21:58:37.813654 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO oslo.messaging._drivers.impl_rabbit [None req-41169a6f-4a99-4d1b-a79b-76e841e2c992 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [8230e8fe-88a1-43db-96a0-98df2b370c2f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59290. Aug 04 21:58:37.817813 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-41169a6f-4a99-4d1b-a79b-76e841e2c992 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.116497 Aug 04 21:58:37.818503 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 578/1164] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 4 21:58:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 2118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:58:37.826819 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=4 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:58:37.827521 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:58:37.831397 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-0ae5f647-4e21-4c80-8158-d2fc7299bb67 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:58:37.832008 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-0ae5f647-4e21-4c80-8158-d2fc7299bb67 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:58:37.888315 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0ae5f647-4e21-4c80-8158-d2fc7299bb67 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:58:37.896511 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-0ae5f647-4e21-4c80-8158-d2fc7299bb67 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1095 microversion: 2.1 time: 0.071145 Aug 04 21:58:37.897045 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 587/1165] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:58:37 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:58:38.917212 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-38f329bf-45bb-495e-9980-06047f97167c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:58:38.917812 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-38f329bf-45bb-495e-9980-06047f97167c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:58:38.977643 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-38f329bf-45bb-495e-9980-06047f97167c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:58:38.984540 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-38f329bf-45bb-495e-9980-06047f97167c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1095 microversion: 2.1 time: 0.071783 Aug 04 21:58:38.985082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 579/1166] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:58:38 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:58:40.006428 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4cf921be-320c-4993-acca-8d6f5e77ff76 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:58:40.007038 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4cf921be-320c-4993-acca-8d6f5e77ff76 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:58:40.061596 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4cf921be-320c-4993-acca-8d6f5e77ff76 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:58:40.069186 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4cf921be-320c-4993-acca-8d6f5e77ff76 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1095 microversion: 2.1 time: 0.067466 Aug 04 21:58:40.069997 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 588/1167] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:58:40 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:58:41.090819 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a459a739-0aed-420c-aa63-30e07b8ab250 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:58:41.091424 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a459a739-0aed-420c-aa63-30e07b8ab250 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:58:41.146879 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a459a739-0aed-420c-aa63-30e07b8ab250 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:58:41.153604 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a459a739-0aed-420c-aa63-30e07b8ab250 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1095 microversion: 2.1 time: 0.066676 Aug 04 21:58:41.154539 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 580/1168] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:58:41 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:58:42.175168 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ef35cd1d-83ee-4dc5-b82f-8df0bc393a52 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:58:42.175793 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ef35cd1d-83ee-4dc5-b82f-8df0bc393a52 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:58:42.182814 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef35cd1d-83ee-4dc5-b82f-8df0bc393a52 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:42.183311 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef35cd1d-83ee-4dc5-b82f-8df0bc393a52 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:42.183759 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef35cd1d-83ee-4dc5-b82f-8df0bc393a52 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:42.184485 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef35cd1d-83ee-4dc5-b82f-8df0bc393a52 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:42.184947 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef35cd1d-83ee-4dc5-b82f-8df0bc393a52 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:42.185376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ef35cd1d-83ee-4dc5-b82f-8df0bc393a52 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:42.245529 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ef35cd1d-83ee-4dc5-b82f-8df0bc393a52 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:58:42.254199 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ef35cd1d-83ee-4dc5-b82f-8df0bc393a52 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1145 microversion: 2.1 time: 0.083361 Aug 04 21:58:42.254755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 589/1169] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:58:42 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:58:43.275305 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a0a79504-fcc9-4da9-bcc3-a1bf10a4f45d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:58:43.276056 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a0a79504-fcc9-4da9-bcc3-a1bf10a4f45d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:58:43.282737 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0a79504-fcc9-4da9-bcc3-a1bf10a4f45d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:43.287750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0a79504-fcc9-4da9-bcc3-a1bf10a4f45d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:43.287750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0a79504-fcc9-4da9-bcc3-a1bf10a4f45d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:43.287750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0a79504-fcc9-4da9-bcc3-a1bf10a4f45d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:43.287750 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0a79504-fcc9-4da9-bcc3-a1bf10a4f45d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:43.288139 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0a79504-fcc9-4da9-bcc3-a1bf10a4f45d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:43.350982 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a0a79504-fcc9-4da9-bcc3-a1bf10a4f45d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:58:43.358457 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a0a79504-fcc9-4da9-bcc3-a1bf10a4f45d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1145 microversion: 2.1 time: 0.087027 Aug 04 21:58:43.359011 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 581/1170] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:58:43 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:58:44.379953 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-03a757a3-4e3d-4ef1-b9ea-896c541b90a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:58:44.380563 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-03a757a3-4e3d-4ef1-b9ea-896c541b90a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:58:44.386730 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03a757a3-4e3d-4ef1-b9ea-896c541b90a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:44.387210 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03a757a3-4e3d-4ef1-b9ea-896c541b90a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:44.387639 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03a757a3-4e3d-4ef1-b9ea-896c541b90a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:44.388326 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03a757a3-4e3d-4ef1-b9ea-896c541b90a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:44.388798 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03a757a3-4e3d-4ef1-b9ea-896c541b90a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:44.389235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-03a757a3-4e3d-4ef1-b9ea-896c541b90a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:44.467884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-03a757a3-4e3d-4ef1-b9ea-896c541b90a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:58:44.476144 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-03a757a3-4e3d-4ef1-b9ea-896c541b90a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1201 microversion: 2.1 time: 0.100478 Aug 04 21:58:44.477252 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 590/1171] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:58:44 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1201 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:58:45.498311 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c6f08a6b-a746-42c8-be68-8f0a9e04b800 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:58:45.501248 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c6f08a6b-a746-42c8-be68-8f0a9e04b800 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:58:45.507416 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c6f08a6b-a746-42c8-be68-8f0a9e04b800 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:45.508202 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c6f08a6b-a746-42c8-be68-8f0a9e04b800 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:45.508809 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c6f08a6b-a746-42c8-be68-8f0a9e04b800 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:45.509513 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c6f08a6b-a746-42c8-be68-8f0a9e04b800 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:45.509964 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c6f08a6b-a746-42c8-be68-8f0a9e04b800 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:45.510413 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c6f08a6b-a746-42c8-be68-8f0a9e04b800 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:45.645021 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-c6f08a6b-a746-42c8-be68-8f0a9e04b800 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:58:45.652999 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c6f08a6b-a746-42c8-be68-8f0a9e04b800 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1278 microversion: 2.1 time: 0.158954 Aug 04 21:58:45.653566 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 582/1172] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:58:45 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:58:45.981961 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-43e5c989-17f3-480d-b562-19952ded0a64 req-95abe13c-3943-4a12-83df-da0950190cfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1de7b9b7-4e16-410d-aca1-86903eb1f8b6", "tag": "04e22766-471e-404f-a467-46f2d75b7fe5"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:58:45.995005 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-43e5c989-17f3-480d-b562-19952ded0a64 req-95abe13c-3943-4a12-83df-da0950190cfe service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:45.995491 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-43e5c989-17f3-480d-b562-19952ded0a64 req-95abe13c-3943-4a12-83df-da0950190cfe service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:45.995977 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-43e5c989-17f3-480d-b562-19952ded0a64 req-95abe13c-3943-4a12-83df-da0950190cfe service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:46.007701 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-43e5c989-17f3-480d-b562-19952ded0a64 req-95abe13c-3943-4a12-83df-da0950190cfe service nova] Creating event network-changed:04e22766-471e-404f-a467-46f2d75b7fe5 for instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 on hv-cinder-85220 Aug 04 21:58:46.012762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-43e5c989-17f3-480d-b562-19952ded0a64 req-95abe13c-3943-4a12-83df-da0950190cfe service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035520 Aug 04 21:58:46.013360 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 591/1173] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:58:46.677388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-61813b31-d1af-409c-b505-d637709cdcdf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:58:46.677996 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-61813b31-d1af-409c-b505-d637709cdcdf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:58:46.679907 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=2 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:58:46.685062 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-61813b31-d1af-409c-b505-d637709cdcdf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:46.685769 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-61813b31-d1af-409c-b505-d637709cdcdf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:46.686246 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-61813b31-d1af-409c-b505-d637709cdcdf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:46.686942 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-61813b31-d1af-409c-b505-d637709cdcdf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:46.687397 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-61813b31-d1af-409c-b505-d637709cdcdf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:46.687817 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-61813b31-d1af-409c-b505-d637709cdcdf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:46.822860 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-61813b31-d1af-409c-b505-d637709cdcdf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:58:46.830414 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-61813b31-d1af-409c-b505-d637709cdcdf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1266 microversion: 2.1 time: 0.157597 Aug 04 21:58:46.830983 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 583/1174] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:58:46 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:58:47.854247 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-21769030-a36b-4eb5-bcb9-ba4ab11fa0e2 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:58:47.855033 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-21769030-a36b-4eb5-bcb9-ba4ab11fa0e2 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:58:47.861127 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-21769030-a36b-4eb5-bcb9-ba4ab11fa0e2 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:47.861610 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-21769030-a36b-4eb5-bcb9-ba4ab11fa0e2 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:47.862064 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-21769030-a36b-4eb5-bcb9-ba4ab11fa0e2 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:47.862760 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-21769030-a36b-4eb5-bcb9-ba4ab11fa0e2 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:47.863220 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-21769030-a36b-4eb5-bcb9-ba4ab11fa0e2 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:47.863638 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-21769030-a36b-4eb5-bcb9-ba4ab11fa0e2 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:47.998554 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-21769030-a36b-4eb5-bcb9-ba4ab11fa0e2 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:58:48.006305 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-21769030-a36b-4eb5-bcb9-ba4ab11fa0e2 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1266 microversion: 2.1 time: 0.156885 Aug 04 21:58:48.006879 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 592/1175] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:58:47 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:58:49.027192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-1cd6d7d9-c2d1-4a86-9794-b34d8768ccbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:58:49.027801 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-1cd6d7d9-c2d1-4a86-9794-b34d8768ccbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:58:49.034440 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1cd6d7d9-c2d1-4a86-9794-b34d8768ccbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:49.034917 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1cd6d7d9-c2d1-4a86-9794-b34d8768ccbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:49.035348 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1cd6d7d9-c2d1-4a86-9794-b34d8768ccbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:49.036034 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1cd6d7d9-c2d1-4a86-9794-b34d8768ccbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:49.036483 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1cd6d7d9-c2d1-4a86-9794-b34d8768ccbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:49.036906 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-1cd6d7d9-c2d1-4a86-9794-b34d8768ccbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:49.165527 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-1cd6d7d9-c2d1-4a86-9794-b34d8768ccbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:58:49.172928 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-1cd6d7d9-c2d1-4a86-9794-b34d8768ccbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1266 microversion: 2.1 time: 0.149611 Aug 04 21:58:49.173484 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 584/1176] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:58:49 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:58:50.194970 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-1cf75294-8201-4229-8778-e3d647ab7f40 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:58:50.195582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-1cf75294-8201-4229-8778-e3d647ab7f40 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:58:50.197941 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=4 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:58:50.202750 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1cf75294-8201-4229-8778-e3d647ab7f40 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:50.203232 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1cf75294-8201-4229-8778-e3d647ab7f40 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:50.203664 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1cf75294-8201-4229-8778-e3d647ab7f40 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:50.204345 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1cf75294-8201-4229-8778-e3d647ab7f40 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:50.204795 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1cf75294-8201-4229-8778-e3d647ab7f40 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:50.205365 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1cf75294-8201-4229-8778-e3d647ab7f40 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:50.337139 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1cf75294-8201-4229-8778-e3d647ab7f40 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:58:50.344734 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-1cf75294-8201-4229-8778-e3d647ab7f40 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1266 microversion: 2.1 time: 0.153714 Aug 04 21:58:50.345298 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 593/1177] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:58:50 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:58:51.365923 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-32af4b1d-1a65-4b46-807c-884c013e5d0d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:58:51.366685 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-32af4b1d-1a65-4b46-807c-884c013e5d0d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:58:51.368422 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=10 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:58:51.373356 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-32af4b1d-1a65-4b46-807c-884c013e5d0d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:51.373859 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-32af4b1d-1a65-4b46-807c-884c013e5d0d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:51.374360 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-32af4b1d-1a65-4b46-807c-884c013e5d0d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:51.382543 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-32af4b1d-1a65-4b46-807c-884c013e5d0d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:51.382543 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-32af4b1d-1a65-4b46-807c-884c013e5d0d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:51.382543 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-32af4b1d-1a65-4b46-807c-884c013e5d0d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:51.767746 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-32af4b1d-1a65-4b46-807c-884c013e5d0d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:58:51.776247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-32af4b1d-1a65-4b46-807c-884c013e5d0d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1266 microversion: 2.1 time: 0.414459 Aug 04 21:58:51.776815 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 585/1178] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:58:51 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1266 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:58:52.796358 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-3bac89d6-99b4-46d6-bf68-7db539701aa9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:58:52.796908 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-3bac89d6-99b4-46d6-bf68-7db539701aa9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:58:52.803273 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bac89d6-99b4-46d6-bf68-7db539701aa9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:52.803750 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bac89d6-99b4-46d6-bf68-7db539701aa9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:52.804176 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bac89d6-99b4-46d6-bf68-7db539701aa9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:52.804861 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bac89d6-99b4-46d6-bf68-7db539701aa9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:52.805305 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bac89d6-99b4-46d6-bf68-7db539701aa9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:52.805723 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bac89d6-99b4-46d6-bf68-7db539701aa9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:52.933855 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-3bac89d6-99b4-46d6-bf68-7db539701aa9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:58:52.941241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-3bac89d6-99b4-46d6-bf68-7db539701aa9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1266 microversion: 2.1 time: 0.148864 Aug 04 21:58:52.941796 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 594/1179] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:58:52 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:58:53.963248 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-20411874-451f-4122-aba1-a76e70dafe84 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:58:53.963854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-20411874-451f-4122-aba1-a76e70dafe84 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:58:53.970318 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-20411874-451f-4122-aba1-a76e70dafe84 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:53.972298 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-20411874-451f-4122-aba1-a76e70dafe84 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:53.972298 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-20411874-451f-4122-aba1-a76e70dafe84 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:53.972298 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-20411874-451f-4122-aba1-a76e70dafe84 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:53.972594 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-20411874-451f-4122-aba1-a76e70dafe84 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:53.972753 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-20411874-451f-4122-aba1-a76e70dafe84 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:54.103008 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-20411874-451f-4122-aba1-a76e70dafe84 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:58:54.110496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-20411874-451f-4122-aba1-a76e70dafe84 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1266 microversion: 2.1 time: 0.152021 Aug 04 21:58:54.111166 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 586/1180] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:58:53 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:58:55.132521 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-24414457-2d2a-46fc-b2a6-d4a5c35eb42d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:58:55.133182 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-24414457-2d2a-46fc-b2a6-d4a5c35eb42d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:58:55.139538 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-24414457-2d2a-46fc-b2a6-d4a5c35eb42d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:55.140021 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-24414457-2d2a-46fc-b2a6-d4a5c35eb42d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:55.140454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-24414457-2d2a-46fc-b2a6-d4a5c35eb42d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:55.141147 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-24414457-2d2a-46fc-b2a6-d4a5c35eb42d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:55.141600 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-24414457-2d2a-46fc-b2a6-d4a5c35eb42d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:55.142037 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-24414457-2d2a-46fc-b2a6-d4a5c35eb42d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:55.277016 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-24414457-2d2a-46fc-b2a6-d4a5c35eb42d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:58:55.284614 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-24414457-2d2a-46fc-b2a6-d4a5c35eb42d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1266 microversion: 2.1 time: 0.156807 Aug 04 21:58:55.285166 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 595/1181] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:58:55 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:58:56.305907 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-dbf318e3-7bfc-4a5c-8325-b7a270ef7f95 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:58:56.306520 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-dbf318e3-7bfc-4a5c-8325-b7a270ef7f95 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:58:56.312791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dbf318e3-7bfc-4a5c-8325-b7a270ef7f95 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:56.313259 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dbf318e3-7bfc-4a5c-8325-b7a270ef7f95 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:56.313681 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dbf318e3-7bfc-4a5c-8325-b7a270ef7f95 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:56.314476 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dbf318e3-7bfc-4a5c-8325-b7a270ef7f95 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:56.314838 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dbf318e3-7bfc-4a5c-8325-b7a270ef7f95 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:56.315246 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dbf318e3-7bfc-4a5c-8325-b7a270ef7f95 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:56.451062 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-dbf318e3-7bfc-4a5c-8325-b7a270ef7f95 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:58:56.458626 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-dbf318e3-7bfc-4a5c-8325-b7a270ef7f95 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1266 microversion: 2.1 time: 0.156968 Aug 04 21:58:56.459188 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 587/1182] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:58:56 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:58:57.479920 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-61c9aeb9-6b91-4ba7-af93-8580bc1973fd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:58:57.480498 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-61c9aeb9-6b91-4ba7-af93-8580bc1973fd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:58:57.486996 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-61c9aeb9-6b91-4ba7-af93-8580bc1973fd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:57.487476 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-61c9aeb9-6b91-4ba7-af93-8580bc1973fd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:57.487907 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-61c9aeb9-6b91-4ba7-af93-8580bc1973fd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:57.488598 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-61c9aeb9-6b91-4ba7-af93-8580bc1973fd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:57.489043 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-61c9aeb9-6b91-4ba7-af93-8580bc1973fd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:57.489652 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-61c9aeb9-6b91-4ba7-af93-8580bc1973fd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:57.623818 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-61c9aeb9-6b91-4ba7-af93-8580bc1973fd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:58:57.631332 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-61c9aeb9-6b91-4ba7-af93-8580bc1973fd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1266 microversion: 2.1 time: 0.155701 Aug 04 21:58:57.631898 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 596/1183] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:58:57 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:58:58.652978 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-af3d2dd5-32ff-4471-b9e4-3c2ac3f30cc7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:58:58.653568 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-af3d2dd5-32ff-4471-b9e4-3c2ac3f30cc7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:58:58.659955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-af3d2dd5-32ff-4471-b9e4-3c2ac3f30cc7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:58.660427 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-af3d2dd5-32ff-4471-b9e4-3c2ac3f30cc7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:58.660854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-af3d2dd5-32ff-4471-b9e4-3c2ac3f30cc7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:58.662339 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-af3d2dd5-32ff-4471-b9e4-3c2ac3f30cc7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:58.662792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-af3d2dd5-32ff-4471-b9e4-3c2ac3f30cc7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:58.663206 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-af3d2dd5-32ff-4471-b9e4-3c2ac3f30cc7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:58.793842 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-af3d2dd5-32ff-4471-b9e4-3c2ac3f30cc7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:58:58.801442 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-af3d2dd5-32ff-4471-b9e4-3c2ac3f30cc7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1266 microversion: 2.1 time: 0.152340 Aug 04 21:58:58.802000 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 588/1184] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:58:58 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:58:59.216899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-6765b429-ebe8-4cec-b138-28e25f84384f req-90527495-a0ae-402e-ba30-91c28bdb853c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1de7b9b7-4e16-410d-aca1-86903eb1f8b6", "name": "network-vif-plugged", "status": "completed", "tag": "04e22766-471e-404f-a467-46f2d75b7fe5"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:58:59.226811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-6765b429-ebe8-4cec-b138-28e25f84384f req-90527495-a0ae-402e-ba30-91c28bdb853c service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:59.227283 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-6765b429-ebe8-4cec-b138-28e25f84384f req-90527495-a0ae-402e-ba30-91c28bdb853c service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:59.227706 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-6765b429-ebe8-4cec-b138-28e25f84384f req-90527495-a0ae-402e-ba30-91c28bdb853c service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:59.238760 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-6765b429-ebe8-4cec-b138-28e25f84384f req-90527495-a0ae-402e-ba30-91c28bdb853c service nova] Creating event network-vif-plugged:04e22766-471e-404f-a467-46f2d75b7fe5 for instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 on hv-cinder-85220 Aug 04 21:58:59.244847 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-6765b429-ebe8-4cec-b138-28e25f84384f req-90527495-a0ae-402e-ba30-91c28bdb853c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094513 Aug 04 21:58:59.245656 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 597/1185] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:58:59.822940 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f6a24c07-1de6-4e0b-918d-04cbb54a6f7d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:58:59.823595 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-f6a24c07-1de6-4e0b-918d-04cbb54a6f7d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:58:59.829983 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f6a24c07-1de6-4e0b-918d-04cbb54a6f7d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:59.830498 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f6a24c07-1de6-4e0b-918d-04cbb54a6f7d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:59.830929 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f6a24c07-1de6-4e0b-918d-04cbb54a6f7d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:59.831618 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f6a24c07-1de6-4e0b-918d-04cbb54a6f7d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:58:59.832065 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f6a24c07-1de6-4e0b-918d-04cbb54a6f7d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:58:59.832487 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f6a24c07-1de6-4e0b-918d-04cbb54a6f7d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:58:59.967123 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-f6a24c07-1de6-4e0b-918d-04cbb54a6f7d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:58:59.975696 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f6a24c07-1de6-4e0b-918d-04cbb54a6f7d tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1266 microversion: 2.1 time: 0.156427 Aug 04 21:58:59.975696 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 589/1186] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:58:59 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:59:00.997467 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-285cfaa4-c38c-48a0-b516-265e949d9d62 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:00.998437 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-285cfaa4-c38c-48a0-b516-265e949d9d62 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:01.006027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-285cfaa4-c38c-48a0-b516-265e949d9d62 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:01.006554 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-285cfaa4-c38c-48a0-b516-265e949d9d62 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:01.006984 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-285cfaa4-c38c-48a0-b516-265e949d9d62 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:01.007916 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-285cfaa4-c38c-48a0-b516-265e949d9d62 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:01.008370 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-285cfaa4-c38c-48a0-b516-265e949d9d62 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:01.008798 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-285cfaa4-c38c-48a0-b516-265e949d9d62 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:01.166356 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-285cfaa4-c38c-48a0-b516-265e949d9d62 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:59:01.174426 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-285cfaa4-c38c-48a0-b516-265e949d9d62 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1266 microversion: 2.1 time: 0.181108 Aug 04 21:59:01.182035 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 598/1187] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:59:00 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:59:02.196443 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-aafe5f33-ce1c-43f4-b6ef-659aa45fcc30 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:02.197046 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-aafe5f33-ce1c-43f4-b6ef-659aa45fcc30 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:02.203468 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aafe5f33-ce1c-43f4-b6ef-659aa45fcc30 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:02.203955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aafe5f33-ce1c-43f4-b6ef-659aa45fcc30 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:02.204391 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aafe5f33-ce1c-43f4-b6ef-659aa45fcc30 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:02.205082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aafe5f33-ce1c-43f4-b6ef-659aa45fcc30 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:02.205534 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aafe5f33-ce1c-43f4-b6ef-659aa45fcc30 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:02.205961 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-aafe5f33-ce1c-43f4-b6ef-659aa45fcc30 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:02.347009 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-aafe5f33-ce1c-43f4-b6ef-659aa45fcc30 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:59:02.355745 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-aafe5f33-ce1c-43f4-b6ef-659aa45fcc30 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1453 microversion: 2.1 time: 0.164225 Aug 04 21:59:02.356310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 590/1188] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:59:02 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:59:02.376654 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-911bd98a-9584-4c60-b9ad-2c6200f053e7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:02.377278 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-911bd98a-9584-4c60-b9ad-2c6200f053e7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:02.383881 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-911bd98a-9584-4c60-b9ad-2c6200f053e7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:02.384366 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-911bd98a-9584-4c60-b9ad-2c6200f053e7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:02.384803 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-911bd98a-9584-4c60-b9ad-2c6200f053e7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:02.385496 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-911bd98a-9584-4c60-b9ad-2c6200f053e7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:02.385951 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-911bd98a-9584-4c60-b9ad-2c6200f053e7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:02.386432 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-911bd98a-9584-4c60-b9ad-2c6200f053e7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:02.521539 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-911bd98a-9584-4c60-b9ad-2c6200f053e7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:59:02.529441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-911bd98a-9584-4c60-b9ad-2c6200f053e7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1453 microversion: 2.1 time: 0.156879 Aug 04 21:59:02.530029 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 599/1189] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:59:02 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:59:04.662046 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b5a1ba87-a90e-4663-b1c8-dc245f248e3c tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:04.662699 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b5a1ba87-a90e-4663-b1c8-dc245f248e3c tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:04.669108 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b5a1ba87-a90e-4663-b1c8-dc245f248e3c tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:04.669634 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b5a1ba87-a90e-4663-b1c8-dc245f248e3c tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:04.670093 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b5a1ba87-a90e-4663-b1c8-dc245f248e3c tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:04.670786 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b5a1ba87-a90e-4663-b1c8-dc245f248e3c tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:04.671234 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b5a1ba87-a90e-4663-b1c8-dc245f248e3c tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:04.671653 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b5a1ba87-a90e-4663-b1c8-dc245f248e3c tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:04.694991 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b5a1ba87-a90e-4663-b1c8-dc245f248e3c tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502/ips" status: 200 len: 150 microversion: 2.1 time: 0.037444 Aug 04 21:59:04.695624 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 591/1190] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 4 21:59:04 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:59:04.879374 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-2a6da617-d707-4432-9b27-bdc6f6ecbf65 req-c1be815d-8cc0-4ae8-8263-e86e1118e1cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1de7b9b7-4e16-410d-aca1-86903eb1f8b6", "tag": "04e22766-471e-404f-a467-46f2d75b7fe5"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:59:04.889727 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-2a6da617-d707-4432-9b27-bdc6f6ecbf65 req-c1be815d-8cc0-4ae8-8263-e86e1118e1cf service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:04.890376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-2a6da617-d707-4432-9b27-bdc6f6ecbf65 req-c1be815d-8cc0-4ae8-8263-e86e1118e1cf service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:04.890805 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-2a6da617-d707-4432-9b27-bdc6f6ecbf65 req-c1be815d-8cc0-4ae8-8263-e86e1118e1cf service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:04.902151 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-2a6da617-d707-4432-9b27-bdc6f6ecbf65 req-c1be815d-8cc0-4ae8-8263-e86e1118e1cf service nova] Creating event network-changed:04e22766-471e-404f-a467-46f2d75b7fe5 for instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 on hv-cinder-85220 Aug 04 21:59:04.907351 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-2a6da617-d707-4432-9b27-bdc6f6ecbf65 req-c1be815d-8cc0-4ae8-8263-e86e1118e1cf service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031661 Aug 04 21:59:04.908282 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 600/1191] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:59:06.347185 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ee0a0e02-4c75-45fe-8d1c-391373f248f8 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eaedbb8c-1721-4e8a-8d2c-9342c305f7f6"}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:59:06.349651 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ee0a0e02-4c75-45fe-8d1c-391373f248f8 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:06.352019 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:59:06.356626 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ee0a0e02-4c75-45fe-8d1c-391373f248f8 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:06.362347 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ee0a0e02-4c75-45fe-8d1c-391373f248f8 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:06.362347 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ee0a0e02-4c75-45fe-8d1c-391373f248f8 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:06.362347 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ee0a0e02-4c75-45fe-8d1c-391373f248f8 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:06.362347 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ee0a0e02-4c75-45fe-8d1c-391373f248f8 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:06.362771 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ee0a0e02-4c75-45fe-8d1c-391373f248f8 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:06.362771 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=67 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:59:07.224149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ee0a0e02-4c75-45fe-8d1c-391373f248f8 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "POST /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.880808 Aug 04 21:59:07.224761 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 592/1192] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 4 21:59:06 2022] POST /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502/os-volume_attachments => generated 194 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:59:15.915505 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=32 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:59:15.916794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=60 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:59:15.921063 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2b8ec751-7197-44a0-a8dc-2d84d36f3461 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:15.921647 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2b8ec751-7197-44a0-a8dc-2d84d36f3461 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:15.927587 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2b8ec751-7197-44a0-a8dc-2d84d36f3461 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:15.929420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2b8ec751-7197-44a0-a8dc-2d84d36f3461 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:15.929420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2b8ec751-7197-44a0-a8dc-2d84d36f3461 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:15.929420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2b8ec751-7197-44a0-a8dc-2d84d36f3461 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:15.929737 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2b8ec751-7197-44a0-a8dc-2d84d36f3461 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:15.929982 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2b8ec751-7197-44a0-a8dc-2d84d36f3461 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:16.010473 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-2b8ec751-7197-44a0-a8dc-2d84d36f3461 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lazy-loading 'services' on Instance uuid 5a202369-bdc9-47b0-b879-3e004088e502 {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:59:16.304233 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2b8ec751-7197-44a0-a8dc-2d84d36f3461 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502/os-volume_attachments/eaedbb8c-1721-4e8a-8d2c-9342c305f7f6" status: 202 len: 0 microversion: 2.1 time: 0.390000 Aug 04 21:59:16.304767 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 601/1193] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 4 21:59:15 2022] DELETE /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502/os-volume_attachments/eaedbb8c-1721-4e8a-8d2c-9342c305f7f6 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:59:16.315141 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-45c86f7a-25a3-46c9-8780-335ef0437a13 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:16.317586 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-45c86f7a-25a3-46c9-8780-335ef0437a13 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:16.324398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-45c86f7a-25a3-46c9-8780-335ef0437a13 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:16.324877 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-45c86f7a-25a3-46c9-8780-335ef0437a13 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:16.325387 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-45c86f7a-25a3-46c9-8780-335ef0437a13 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:16.326129 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-45c86f7a-25a3-46c9-8780-335ef0437a13 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:16.326601 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-45c86f7a-25a3-46c9-8780-335ef0437a13 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:16.327017 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-45c86f7a-25a3-46c9-8780-335ef0437a13 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:16.356252 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-45c86f7a-25a3-46c9-8780-335ef0437a13 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046256 Aug 04 21:59:16.362352 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 593/1194] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:59:16 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:59:17.369725 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ac379210-57e6-407b-ae2c-8c9e2bb4f785 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:17.372063 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ac379210-57e6-407b-ae2c-8c9e2bb4f785 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:17.378609 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ac379210-57e6-407b-ae2c-8c9e2bb4f785 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:17.379140 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ac379210-57e6-407b-ae2c-8c9e2bb4f785 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:17.379532 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ac379210-57e6-407b-ae2c-8c9e2bb4f785 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:17.380235 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ac379210-57e6-407b-ae2c-8c9e2bb4f785 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:17.380685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ac379210-57e6-407b-ae2c-8c9e2bb4f785 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:17.381106 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ac379210-57e6-407b-ae2c-8c9e2bb4f785 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:17.411785 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ac379210-57e6-407b-ae2c-8c9e2bb4f785 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046962 Aug 04 21:59:17.412249 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 602/1195] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:59:17 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:59:18.424625 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-f6af85a9-eabf-4947-8924-1730462f7764 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:18.426934 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-f6af85a9-eabf-4947-8924-1730462f7764 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:18.434751 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f6af85a9-eabf-4947-8924-1730462f7764 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:18.435243 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f6af85a9-eabf-4947-8924-1730462f7764 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:18.435678 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f6af85a9-eabf-4947-8924-1730462f7764 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:18.436387 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f6af85a9-eabf-4947-8924-1730462f7764 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:18.436836 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f6af85a9-eabf-4947-8924-1730462f7764 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:18.437258 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-f6af85a9-eabf-4947-8924-1730462f7764 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:18.471310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-f6af85a9-eabf-4947-8924-1730462f7764 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050845 Aug 04 21:59:18.471895 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 594/1196] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 4 21:59:18 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:59:18.538648 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-c64f9588-1e90-4042-96f7-2af0a3eba7ec tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:18.539237 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-c64f9588-1e90-4042-96f7-2af0a3eba7ec tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:18.545967 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c64f9588-1e90-4042-96f7-2af0a3eba7ec tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:18.546493 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c64f9588-1e90-4042-96f7-2af0a3eba7ec tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:18.546925 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c64f9588-1e90-4042-96f7-2af0a3eba7ec tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:18.547634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c64f9588-1e90-4042-96f7-2af0a3eba7ec tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:18.548077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c64f9588-1e90-4042-96f7-2af0a3eba7ec tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:18.548494 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c64f9588-1e90-4042-96f7-2af0a3eba7ec tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:18.576420 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-c64f9588-1e90-4042-96f7-2af0a3eba7ec tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Going to try to terminate instance {{(pid=136342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:59:18.859464 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-c64f9588-1e90-4042-96f7-2af0a3eba7ec tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502" status: 204 len: 0 microversion: 2.1 time: 0.324661 Aug 04 21:59:18.860080 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 603/1197] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:59:18 2022] DELETE /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:59:18.868699 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-214e459d-c8dc-4148-bcd5-3397f3f4dcd1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:18.869320 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-214e459d-c8dc-4148-bcd5-3397f3f4dcd1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:18.876917 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-214e459d-c8dc-4148-bcd5-3397f3f4dcd1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:18.877493 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-214e459d-c8dc-4148-bcd5-3397f3f4dcd1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:18.877917 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-214e459d-c8dc-4148-bcd5-3397f3f4dcd1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:18.878624 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-214e459d-c8dc-4148-bcd5-3397f3f4dcd1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:18.879066 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-214e459d-c8dc-4148-bcd5-3397f3f4dcd1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:18.879483 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-214e459d-c8dc-4148-bcd5-3397f3f4dcd1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:19.010820 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-214e459d-c8dc-4148-bcd5-3397f3f4dcd1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:59:19.018313 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-214e459d-c8dc-4148-bcd5-3397f3f4dcd1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502" status: 200 len: 1680 microversion: 2.1 time: 0.153641 Aug 04 21:59:19.018863 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 595/1198] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:59:18 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:59:20.041707 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-7836e676-373e-446b-819b-95ad5cdd11d4 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:20.042532 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7836e676-373e-446b-819b-95ad5cdd11d4 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:20.049022 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7836e676-373e-446b-819b-95ad5cdd11d4 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:20.049563 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7836e676-373e-446b-819b-95ad5cdd11d4 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:20.049956 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7836e676-373e-446b-819b-95ad5cdd11d4 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:20.050686 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7836e676-373e-446b-819b-95ad5cdd11d4 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:20.051141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7836e676-373e-446b-819b-95ad5cdd11d4 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:20.051592 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7836e676-373e-446b-819b-95ad5cdd11d4 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:20.190550 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7836e676-373e-446b-819b-95ad5cdd11d4 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:59:20.198254 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-7836e676-373e-446b-819b-95ad5cdd11d4 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502" status: 200 len: 1680 microversion: 2.1 time: 0.161340 Aug 04 21:59:20.198822 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 604/1199] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:59:20 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:59:21.219841 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-8bd5b71d-148f-4aae-b1dd-92b143b8a3ab tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:21.220471 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-8bd5b71d-148f-4aae-b1dd-92b143b8a3ab tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:21.227370 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8bd5b71d-148f-4aae-b1dd-92b143b8a3ab tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:21.227862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8bd5b71d-148f-4aae-b1dd-92b143b8a3ab tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:21.228302 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8bd5b71d-148f-4aae-b1dd-92b143b8a3ab tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:21.229786 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8bd5b71d-148f-4aae-b1dd-92b143b8a3ab tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:21.230295 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8bd5b71d-148f-4aae-b1dd-92b143b8a3ab tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:21.230724 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8bd5b71d-148f-4aae-b1dd-92b143b8a3ab tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:21.374097 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-8bd5b71d-148f-4aae-b1dd-92b143b8a3ab tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:59:21.381771 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-8bd5b71d-148f-4aae-b1dd-92b143b8a3ab tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502" status: 200 len: 1680 microversion: 2.1 time: 0.165838 Aug 04 21:59:21.394035 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 596/1200] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:59:21 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:59:22.154589 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-fb7b77c9-f20c-48cc-9038-f9477dd0e480 req-62513599-f2d6-474b-bb5b-3f795c0d03ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a202369-bdc9-47b0-b879-3e004088e502", "name": "network-vif-deleted", "tag": "339a85bf-dea4-4876-9134-03c437159fea"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:59:22.164466 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-fb7b77c9-f20c-48cc-9038-f9477dd0e480 req-62513599-f2d6-474b-bb5b-3f795c0d03ac service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:22.169410 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-fb7b77c9-f20c-48cc-9038-f9477dd0e480 req-62513599-f2d6-474b-bb5b-3f795c0d03ac service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:22.169410 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-fb7b77c9-f20c-48cc-9038-f9477dd0e480 req-62513599-f2d6-474b-bb5b-3f795c0d03ac service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:22.181048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-fb7b77c9-f20c-48cc-9038-f9477dd0e480 req-62513599-f2d6-474b-bb5b-3f795c0d03ac service nova] Creating event network-vif-deleted:339a85bf-dea4-4876-9134-03c437159fea for instance 5a202369-bdc9-47b0-b879-3e004088e502 on hv-cinder-85220 Aug 04 21:59:22.186976 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-fb7b77c9-f20c-48cc-9038-f9477dd0e480 req-62513599-f2d6-474b-bb5b-3f795c0d03ac service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036684 Aug 04 21:59:22.187580 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 605/1201] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 21:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:59:22.404396 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ab8ae5a2-e3bc-415f-9473-c41c5c46dd8f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:22.404994 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ab8ae5a2-e3bc-415f-9473-c41c5c46dd8f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:22.411505 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ab8ae5a2-e3bc-415f-9473-c41c5c46dd8f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:22.411993 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ab8ae5a2-e3bc-415f-9473-c41c5c46dd8f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:22.412421 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ab8ae5a2-e3bc-415f-9473-c41c5c46dd8f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:22.413113 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ab8ae5a2-e3bc-415f-9473-c41c5c46dd8f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:22.413562 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ab8ae5a2-e3bc-415f-9473-c41c5c46dd8f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:22.413980 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ab8ae5a2-e3bc-415f-9473-c41c5c46dd8f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:22.478275 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ab8ae5a2-e3bc-415f-9473-c41c5c46dd8f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a022ce50f3334e919dcf0008bb6afcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4ab3c7309249228e42c226277fb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:59:22.486496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ab8ae5a2-e3bc-415f-9473-c41c5c46dd8f tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502" status: 200 len: 1324 microversion: 2.1 time: 0.086927 Aug 04 21:59:22.487162 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 597/1202] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:59:22 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 => generated 1324 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:59:23.511140 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6395f57f-0b6a-4b01-a734-419c0c0945aa tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:23.512169 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-6395f57f-0b6a-4b01-a734-419c0c0945aa tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:23.519831 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6395f57f-0b6a-4b01-a734-419c0c0945aa tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:23.522400 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6395f57f-0b6a-4b01-a734-419c0c0945aa tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:23.522400 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6395f57f-0b6a-4b01-a734-419c0c0945aa tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:23.522400 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6395f57f-0b6a-4b01-a734-419c0c0945aa tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:23.522400 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6395f57f-0b6a-4b01-a734-419c0c0945aa tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:23.523329 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-6395f57f-0b6a-4b01-a734-419c0c0945aa tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:23.537627 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-6395f57f-0b6a-4b01-a734-419c0c0945aa tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] HTTP exception thrown: Instance 5a202369-bdc9-47b0-b879-3e004088e502 could not be found. Aug 04 21:59:23.539328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6395f57f-0b6a-4b01-a734-419c0c0945aa tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Request method failure captured: Aug 04 21:59:23.539328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 HTTP/1.1 Aug 04 21:59:23.539328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:59:23.539328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:59:23.539328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:59:23.539328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:59:23.539328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:59:23.539328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:59:23.539328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:59:23.539328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:59:23.539328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7D9t8rsKG84MG-XeY6Nlc6oGUGTGzOn1qsEfIgp1-xWWIq9149YutAj8rytKzxl4OvY1D-ym8-Nqng1af7gQx4CCQV_83zm6k1TU_HYRQtFUyhCDmnq8eGjcIc6yEaD-_4bsQnyh21Y-tgkQxsJlI6-_LY5y9tnue57bh7Fq5uafa0U Aug 04 21:59:23.539328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:59:23.539328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:59:23.539328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:59:23.539328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:59:23.539328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:59:23.539328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:59:23.539328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:59:23.539328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:23.539328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:59:23.539328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:59:23.542307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8c4ab3c7309249228e42c226277fb14f", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:59:23.542307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:23.542307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:59:23.542307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:23.542307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:59:23.542307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:59:23.542307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:59:23.542307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: a022ce50f3334e919dcf0008bb6afcf8 Aug 04 21:59:23.542307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:59:23.542307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:59:23.542307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance 5a202369-bdc9-47b0-b879-3e004088e502 could not be found. Aug 04 21:59:23.542307 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': '5a202369-bdc9-47b0-b879-3e004088e502'} Aug 04 21:59:23.544009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:59:23.544009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:23.544009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:59:23.544009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:59:23.544009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:59:23.544009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:59:23.544009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:59:23.544009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:59:23.544009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:59:23.544009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:59:23.544009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a202369-bdc9-47b0-b879-3e004088e502 could not be found. Aug 04 21:59:23.544009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:23.544009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:23.544009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:23.544009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:23.544009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:23.544009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:23.544009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:59:23.544009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:59:23.544009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:59:23.551579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:59:23.551579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:59:23.551579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:59:23.551579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:59:23.551579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:59:23.551579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:59:23.551579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:59:23.551579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a202369-bdc9-47b0-b879-3e004088e502 could not be found. Aug 04 21:59:23.551579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:23.551579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:23.551579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:23.551579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:23.551579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:23.551579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:23.551579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:59:23.551579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:59:23.551579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a202369-bdc9-47b0-b879-3e004088e502 could not be found. Aug 04 21:59:23.551579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:23.554200 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-6395f57f-0b6a-4b01-a734-419c0c0945aa tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Returning 404 to user: Instance 5a202369-bdc9-47b0-b879-3e004088e502 could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:59:23.554200 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-6395f57f-0b6a-4b01-a734-419c0c0945aa tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502" status: 404 len: 111 microversion: 2.1 time: 0.035326 Aug 04 21:59:23.554200 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 606/1203] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:59:23 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:59:23.554677 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-365819db-22ca-42cc-bb6d-388c6b699e18 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '.version_select at 0x7f3c10894670>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:23.624253 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-365819db-22ca-42cc-bb6d-388c6b699e18 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-523835242" status: 202 len: 0 microversion: 2.1 time: 0.078271 Aug 04 21:59:23.624870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 598/1204] 10.222.0.73 () {58 vars in 1218 bytes} [Thu Aug 4 21:59:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-523835242 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:59:25.708348 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-638985c2-e3e1-4d43-84bf-0e68b67d9bf9 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:25.708944 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-638985c2-e3e1-4d43-84bf-0e68b67d9bf9 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:25.715524 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-638985c2-e3e1-4d43-84bf-0e68b67d9bf9 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:25.716003 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-638985c2-e3e1-4d43-84bf-0e68b67d9bf9 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:25.716436 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-638985c2-e3e1-4d43-84bf-0e68b67d9bf9 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:25.717119 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-638985c2-e3e1-4d43-84bf-0e68b67d9bf9 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:25.717569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-638985c2-e3e1-4d43-84bf-0e68b67d9bf9 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:25.717991 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-638985c2-e3e1-4d43-84bf-0e68b67d9bf9 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:25.732080 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-638985c2-e3e1-4d43-84bf-0e68b67d9bf9 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] HTTP exception thrown: Instance 5a202369-bdc9-47b0-b879-3e004088e502 could not be found. Aug 04 21:59:25.733569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-638985c2-e3e1-4d43-84bf-0e68b67d9bf9 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Request method failure captured: Aug 04 21:59:25.733569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: DELETE /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 HTTP/1.1 Aug 04 21:59:25.733569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:59:25.733569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:59:25.733569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:59:25.733569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:59:25.733569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:59:25.733569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:59:25.733569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:59:25.733569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:59:25.733569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7D9t8rsKG84MG-XeY6Nlc6oGUGTGzOn1qsEfIgp1-xWWIq9149YutAj8rytKzxl4OvY1D-ym8-Nqng1af7gQx4CCQV_83zm6k1TU_HYRQtFUyhCDmnq8eGjcIc6yEaD-_4bsQnyh21Y-tgkQxsJlI6-_LY5y9tnue57bh7Fq5uafa0U Aug 04 21:59:25.733569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:59:25.733569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:59:25.733569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:59:25.733569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:59:25.733569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:59:25.733569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:59:25.733569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:59:25.733569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:25.733569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:59:25.733569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:59:25.735241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8c4ab3c7309249228e42c226277fb14f", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:59:25.735241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:25.735241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:59:25.735241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:25.735241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:59:25.735241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:59:25.735241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:59:25.735241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: a022ce50f3334e919dcf0008bb6afcf8 Aug 04 21:59:25.735241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:59:25.735241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:59:25.735241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance 5a202369-bdc9-47b0-b879-3e004088e502 could not be found. Aug 04 21:59:25.735241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': '5a202369-bdc9-47b0-b879-3e004088e502'} Aug 04 21:59:25.736179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:59:25.736179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:25.736179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:59:25.736179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:59:25.736179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:59:25.736179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:59:25.736179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:59:25.736179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:59:25.736179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:59:25.736179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:59:25.736179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a202369-bdc9-47b0-b879-3e004088e502 could not be found. Aug 04 21:59:25.736179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:25.736179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:25.736179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:25.736179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:25.736179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:25.736179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:25.736179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:59:25.736179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:59:25.736179 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:59:25.737884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:59:25.737884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:59:25.737884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:59:25.737884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:59:25.737884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:59:25.737884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:59:25.737884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:59:25.737884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:59:25.737884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:59:25.737884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a202369-bdc9-47b0-b879-3e004088e502 could not be found. Aug 04 21:59:25.737884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:25.737884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:25.737884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:25.737884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:25.737884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:25.737884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:25.737884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:59:25.737884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:59:25.737884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a202369-bdc9-47b0-b879-3e004088e502 could not be found. Aug 04 21:59:25.737884 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:25.739435 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-638985c2-e3e1-4d43-84bf-0e68b67d9bf9 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Returning 404 to user: Instance 5a202369-bdc9-47b0-b879-3e004088e502 could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:59:25.739435 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-638985c2-e3e1-4d43-84bf-0e68b67d9bf9 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502" status: 404 len: 111 microversion: 2.1 time: 0.030677 Aug 04 21:59:25.739435 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 607/1205] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:59:25 2022] DELETE /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:59:25.743591 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-16145af1-a651-4c3b-bde3-0b14153ca51b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:25.746539 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-16145af1-a651-4c3b-bde3-0b14153ca51b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 5a202369-bdc9-47b0-b879-3e004088e502] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:25.752061 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-16145af1-a651-4c3b-bde3-0b14153ca51b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:25.752543 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-16145af1-a651-4c3b-bde3-0b14153ca51b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:25.752978 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-16145af1-a651-4c3b-bde3-0b14153ca51b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:25.753663 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-16145af1-a651-4c3b-bde3-0b14153ca51b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:25.754142 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-16145af1-a651-4c3b-bde3-0b14153ca51b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:25.754563 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-16145af1-a651-4c3b-bde3-0b14153ca51b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:25.767590 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-16145af1-a651-4c3b-bde3-0b14153ca51b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] HTTP exception thrown: Instance 5a202369-bdc9-47b0-b879-3e004088e502 could not be found. Aug 04 21:59:25.769235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-16145af1-a651-4c3b-bde3-0b14153ca51b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Request method failure captured: Aug 04 21:59:25.769235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 HTTP/1.1 Aug 04 21:59:25.769235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:59:25.769235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:59:25.769235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:59:25.769235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 21:59:25.769235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:59:25.769235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:59:25.769235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:59:25.769235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:59:25.769235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7D9t8rsKG84MG-XeY6Nlc6oGUGTGzOn1qsEfIgp1-xWWIq9149YutAj8rytKzxl4OvY1D-ym8-Nqng1af7gQx4CCQV_83zm6k1TU_HYRQtFUyhCDmnq8eGjcIc6yEaD-_4bsQnyh21Y-tgkQxsJlI6-_LY5y9tnue57bh7Fq5uafa0U Aug 04 21:59:25.769235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:59:25.769235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:59:25.769235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:59:25.769235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:59:25.769235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:59:25.769235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:59:25.769235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:59:25.769235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:25.769235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:59:25.769235 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:59:25.770902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8c4ab3c7309249228e42c226277fb14f", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:59:25.770902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:25.770902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:59:25.770902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:25.770902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:59:25.770902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:59:25.770902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:59:25.770902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: a022ce50f3334e919dcf0008bb6afcf8 Aug 04 21:59:25.770902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:59:25.770902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 21:59:25.770902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Instance 5a202369-bdc9-47b0-b879-3e004088e502 could not be found. Aug 04 21:59:25.770902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': '5a202369-bdc9-47b0-b879-3e004088e502'} Aug 04 21:59:25.771976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:59:25.771976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:25.771976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:59:25.771976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:59:25.771976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:59:25.771976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:59:25.771976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:59:25.771976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:59:25.771976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:59:25.771976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:59:25.771976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a202369-bdc9-47b0-b879-3e004088e502 could not be found. Aug 04 21:59:25.771976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:25.771976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:25.771976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:25.771976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:25.771976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:25.771976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:25.771976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:59:25.771976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:59:25.771976 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:59:25.773304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:59:25.773304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:59:25.773304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:59:25.773304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:59:25.773304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:59:25.773304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:59:25.773304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:59:25.773304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a202369-bdc9-47b0-b879-3e004088e502 could not be found. Aug 04 21:59:25.773304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:25.773304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:25.773304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:25.773304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:25.773304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:25.773304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:25.773304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:59:25.773304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:59:25.773304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a202369-bdc9-47b0-b879-3e004088e502 could not be found. Aug 04 21:59:25.773304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:25.774802 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-16145af1-a651-4c3b-bde3-0b14153ca51b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Returning 404 to user: Instance 5a202369-bdc9-47b0-b879-3e004088e502 could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:59:25.774802 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-16145af1-a651-4c3b-bde3-0b14153ca51b tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502" status: 404 len: 111 microversion: 2.1 time: 0.030960 Aug 04 21:59:25.774802 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 599/1206] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:59:25 2022] GET /compute/v2.1/servers/5a202369-bdc9-47b0-b879-3e004088e502 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:59:27.150450 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-10aed749-9da1-4e92-9a20-6f2ab8250f70 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:27.150970 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-10aed749-9da1-4e92-9a20-6f2ab8250f70 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:27.157555 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-10aed749-9da1-4e92-9a20-6f2ab8250f70 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:27.158068 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-10aed749-9da1-4e92-9a20-6f2ab8250f70 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:27.158503 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-10aed749-9da1-4e92-9a20-6f2ab8250f70 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:27.159199 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-10aed749-9da1-4e92-9a20-6f2ab8250f70 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:27.159646 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-10aed749-9da1-4e92-9a20-6f2ab8250f70 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:27.160063 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-10aed749-9da1-4e92-9a20-6f2ab8250f70 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:27.177300 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-10aed749-9da1-4e92-9a20-6f2ab8250f70 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] HTTP exception thrown: Instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b could not be found. Aug 04 21:59:27.178886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-10aed749-9da1-4e92-9a20-6f2ab8250f70 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Request method failure captured: Aug 04 21:59:27.178886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: DELETE /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b HTTP/1.1 Aug 04 21:59:27.178886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:59:27.178886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:59:27.178886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:59:27.178886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:59:27.178886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:59:27.178886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:59:27.178886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:59:27.178886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:59:27.178886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7D9t8rsKG84MG-XeY6Nlc6oGUGTGzOn1qsEfIgp1-xWWIq9149YutAj8rytKzxl4OvY1D-ym8-Nqng1af7gQx4CCQV_83zm6k1TU_HYRQtFUyhCDmnq8eGjcIc6yEaD-_4bsQnyh21Y-tgkQxsJlI6-_LY5y9tnue57bh7Fq5uafa0U Aug 04 21:59:27.178886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:59:27.178886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:59:27.178886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:59:27.178886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:59:27.178886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:59:27.178886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:59:27.178886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:59:27.178886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:27.178886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:59:27.178886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:59:27.180589 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8c4ab3c7309249228e42c226277fb14f", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:59:27.180589 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:27.180589 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:59:27.180589 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:27.180589 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:59:27.180589 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:59:27.180589 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:59:27.180589 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: a022ce50f3334e919dcf0008bb6afcf8 Aug 04 21:59:27.180589 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:59:27.180589 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:59:27.180589 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b could not be found. Aug 04 21:59:27.180589 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': 'ebeb1675-f6ec-4a67-98ce-901e1e4f839b'} Aug 04 21:59:27.181527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:59:27.181527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:27.181527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:59:27.181527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:59:27.181527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:59:27.181527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:59:27.181527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:59:27.181527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:59:27.181527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:59:27.181527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:59:27.181527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b could not be found. Aug 04 21:59:27.181527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:27.181527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:27.181527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:27.181527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:27.181527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:27.181527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:27.181527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:59:27.181527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:59:27.181527 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:59:27.183077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:59:27.183077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:59:27.183077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:59:27.183077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:59:27.183077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:59:27.183077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:59:27.183077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:59:27.183077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:59:27.183077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:59:27.183077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b could not be found. Aug 04 21:59:27.183077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:27.183077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:27.183077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:27.183077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:27.183077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:27.183077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:27.183077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:59:27.183077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:59:27.183077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b could not be found. Aug 04 21:59:27.183077 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:27.185304 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-10aed749-9da1-4e92-9a20-6f2ab8250f70 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Returning 404 to user: Instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:59:27.185304 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-10aed749-9da1-4e92-9a20-6f2ab8250f70 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b" status: 404 len: 111 microversion: 2.1 time: 0.033656 Aug 04 21:59:27.185304 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 608/1207] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:59:27 2022] DELETE /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:59:27.189429 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-9034decf-427a-422a-b7f0-4bdf0c3a7bc1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:27.190064 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-9034decf-427a-422a-b7f0-4bdf0c3a7bc1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: ebeb1675-f6ec-4a67-98ce-901e1e4f839b] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:27.196811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9034decf-427a-422a-b7f0-4bdf0c3a7bc1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:27.197286 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9034decf-427a-422a-b7f0-4bdf0c3a7bc1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:27.197768 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9034decf-427a-422a-b7f0-4bdf0c3a7bc1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:27.198418 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9034decf-427a-422a-b7f0-4bdf0c3a7bc1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:27.198885 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9034decf-427a-422a-b7f0-4bdf0c3a7bc1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:27.199336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9034decf-427a-422a-b7f0-4bdf0c3a7bc1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:27.212312 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-9034decf-427a-422a-b7f0-4bdf0c3a7bc1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] HTTP exception thrown: Instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b could not be found. Aug 04 21:59:27.213843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-9034decf-427a-422a-b7f0-4bdf0c3a7bc1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Request method failure captured: Aug 04 21:59:27.213843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b HTTP/1.1 Aug 04 21:59:27.213843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:59:27.213843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:59:27.213843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:59:27.213843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 21:59:27.213843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:59:27.213843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:59:27.213843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:59:27.213843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:59:27.213843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7D9t8rsKG84MG-XeY6Nlc6oGUGTGzOn1qsEfIgp1-xWWIq9149YutAj8rytKzxl4OvY1D-ym8-Nqng1af7gQx4CCQV_83zm6k1TU_HYRQtFUyhCDmnq8eGjcIc6yEaD-_4bsQnyh21Y-tgkQxsJlI6-_LY5y9tnue57bh7Fq5uafa0U Aug 04 21:59:27.213843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:59:27.213843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:59:27.213843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:59:27.213843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:59:27.213843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:59:27.213843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:59:27.213843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:59:27.213843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:27.213843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:59:27.213843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:59:27.216140 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8c4ab3c7309249228e42c226277fb14f", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:59:27.216140 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:27.216140 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:59:27.216140 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:27.216140 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:59:27.216140 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:59:27.216140 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:59:27.216140 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: a022ce50f3334e919dcf0008bb6afcf8 Aug 04 21:59:27.216140 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:59:27.216140 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 21:59:27.216140 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b could not be found. Aug 04 21:59:27.216140 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': 'ebeb1675-f6ec-4a67-98ce-901e1e4f839b'} Aug 04 21:59:27.217051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:59:27.217051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:27.217051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:59:27.217051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:59:27.217051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:59:27.217051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:59:27.217051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:59:27.217051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:59:27.217051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:59:27.217051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:59:27.217051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b could not be found. Aug 04 21:59:27.217051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:27.217051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:27.217051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:27.217051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:27.217051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:27.217051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:27.217051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:59:27.217051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:59:27.217051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:59:27.218576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:59:27.218576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:59:27.218576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:59:27.218576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:59:27.218576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:59:27.218576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:59:27.218576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:59:27.218576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b could not be found. Aug 04 21:59:27.218576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:27.218576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:27.218576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:27.218576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:27.218576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:27.218576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:27.218576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:59:27.218576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:59:27.218576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b could not be found. Aug 04 21:59:27.218576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:27.219879 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-9034decf-427a-422a-b7f0-4bdf0c3a7bc1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Returning 404 to user: Instance ebeb1675-f6ec-4a67-98ce-901e1e4f839b could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:59:27.219879 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-9034decf-427a-422a-b7f0-4bdf0c3a7bc1 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b" status: 404 len: 111 microversion: 2.1 time: 0.030134 Aug 04 21:59:27.219879 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 600/1208] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:59:27 2022] GET /compute/v2.1/servers/ebeb1675-f6ec-4a67-98ce-901e1e4f839b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:59:27.224347 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-89912ab5-9cf0-4a2a-8f0a-891c942325ca tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:27.224845 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-89912ab5-9cf0-4a2a-8f0a-891c942325ca tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:27.231585 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-89912ab5-9cf0-4a2a-8f0a-891c942325ca tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:27.232068 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-89912ab5-9cf0-4a2a-8f0a-891c942325ca tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:27.232507 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-89912ab5-9cf0-4a2a-8f0a-891c942325ca tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:27.233195 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-89912ab5-9cf0-4a2a-8f0a-891c942325ca tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:27.233647 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-89912ab5-9cf0-4a2a-8f0a-891c942325ca tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:27.234095 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-89912ab5-9cf0-4a2a-8f0a-891c942325ca tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:27.247231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-89912ab5-9cf0-4a2a-8f0a-891c942325ca tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] HTTP exception thrown: Instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 could not be found. Aug 04 21:59:27.249098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-89912ab5-9cf0-4a2a-8f0a-891c942325ca tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Request method failure captured: Aug 04 21:59:27.249098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: DELETE /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 HTTP/1.1 Aug 04 21:59:27.249098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:59:27.249098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:59:27.249098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:59:27.249098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:59:27.249098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:59:27.249098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:59:27.249098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:59:27.249098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:59:27.249098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7D9t8rsKG84MG-XeY6Nlc6oGUGTGzOn1qsEfIgp1-xWWIq9149YutAj8rytKzxl4OvY1D-ym8-Nqng1af7gQx4CCQV_83zm6k1TU_HYRQtFUyhCDmnq8eGjcIc6yEaD-_4bsQnyh21Y-tgkQxsJlI6-_LY5y9tnue57bh7Fq5uafa0U Aug 04 21:59:27.249098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:59:27.249098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:59:27.249098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:59:27.249098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:59:27.249098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:59:27.249098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:59:27.249098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:59:27.249098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:27.249098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:59:27.249098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:59:27.250743 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8c4ab3c7309249228e42c226277fb14f", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:59:27.250743 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:27.250743 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:59:27.250743 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:27.250743 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:59:27.250743 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:59:27.250743 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:59:27.250743 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: a022ce50f3334e919dcf0008bb6afcf8 Aug 04 21:59:27.250743 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:59:27.250743 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:59:27.250743 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 could not be found. Aug 04 21:59:27.250743 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': '14c3d2d2-5c7d-4f15-80c9-7cdc84595f10'} Aug 04 21:59:27.251708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:59:27.251708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:27.251708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:59:27.251708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:59:27.251708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:59:27.251708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:59:27.251708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:59:27.251708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:59:27.251708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:59:27.251708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:59:27.251708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 could not be found. Aug 04 21:59:27.251708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:27.251708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:27.251708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:27.251708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:27.251708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:27.251708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:27.251708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:59:27.251708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:59:27.251708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:59:27.253027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:59:27.253027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:59:27.253027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:59:27.253027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:59:27.253027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:59:27.253027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:59:27.253027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:59:27.253027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:59:27.253027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:59:27.253027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 could not be found. Aug 04 21:59:27.253027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:27.253027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:27.253027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:27.253027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:27.253027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:27.253027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:27.253027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:59:27.253027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:59:27.253027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 could not be found. Aug 04 21:59:27.253027 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:27.254496 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-89912ab5-9cf0-4a2a-8f0a-891c942325ca tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Returning 404 to user: Instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:59:27.254496 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-89912ab5-9cf0-4a2a-8f0a-891c942325ca tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "DELETE /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10" status: 404 len: 111 microversion: 2.1 time: 0.030055 Aug 04 21:59:27.254496 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 609/1209] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:59:27 2022] DELETE /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:59:27.258838 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a911b976-a12d-452d-8841-b2a09d7836bb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:27.259452 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a911b976-a12d-452d-8841-b2a09d7836bb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:27.265848 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a911b976-a12d-452d-8841-b2a09d7836bb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:27.266374 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a911b976-a12d-452d-8841-b2a09d7836bb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:27.266816 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a911b976-a12d-452d-8841-b2a09d7836bb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:27.267510 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a911b976-a12d-452d-8841-b2a09d7836bb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:27.267962 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a911b976-a12d-452d-8841-b2a09d7836bb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:27.268413 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a911b976-a12d-452d-8841-b2a09d7836bb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:27.282713 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-a911b976-a12d-452d-8841-b2a09d7836bb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] HTTP exception thrown: Instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 could not be found. Aug 04 21:59:27.284255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a911b976-a12d-452d-8841-b2a09d7836bb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Request method failure captured: Aug 04 21:59:27.284255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 HTTP/1.1 Aug 04 21:59:27.284255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:59:27.284255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:59:27.284255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:59:27.284255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 21:59:27.284255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:59:27.284255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:59:27.284255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:59:27.284255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:59:27.284255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7D9t8rsKG84MG-XeY6Nlc6oGUGTGzOn1qsEfIgp1-xWWIq9149YutAj8rytKzxl4OvY1D-ym8-Nqng1af7gQx4CCQV_83zm6k1TU_HYRQtFUyhCDmnq8eGjcIc6yEaD-_4bsQnyh21Y-tgkQxsJlI6-_LY5y9tnue57bh7Fq5uafa0U Aug 04 21:59:27.284255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:59:27.284255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:59:27.284255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:59:27.284255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:59:27.284255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:59:27.284255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:59:27.284255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:59:27.284255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:27.284255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:59:27.284255 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:59:27.285894 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8c4ab3c7309249228e42c226277fb14f", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:59:27.285894 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:27.285894 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:59:27.285894 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:27.285894 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:59:27.285894 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:59:27.285894 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:59:27.285894 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: a022ce50f3334e919dcf0008bb6afcf8 Aug 04 21:59:27.285894 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:59:27.285894 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 21:59:27.285894 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 could not be found. Aug 04 21:59:27.285894 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': '14c3d2d2-5c7d-4f15-80c9-7cdc84595f10'} Aug 04 21:59:27.286957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:59:27.286957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:27.286957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:59:27.286957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:59:27.286957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:59:27.286957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:59:27.286957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:59:27.286957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:59:27.286957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:59:27.286957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:59:27.286957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 could not be found. Aug 04 21:59:27.286957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:27.286957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:27.286957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:27.286957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:27.286957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:27.286957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:27.286957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:59:27.286957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:59:27.286957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:59:27.288464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:59:27.288464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:59:27.288464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:59:27.288464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:59:27.288464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:59:27.288464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:59:27.288464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:59:27.288464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 could not be found. Aug 04 21:59:27.288464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:27.288464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:27.288464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:27.288464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:27.288464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:27.288464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:27.288464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:59:27.288464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:59:27.288464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 could not be found. Aug 04 21:59:27.288464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:27.289799 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a911b976-a12d-452d-8841-b2a09d7836bb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Returning 404 to user: Instance 14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:59:27.289799 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a911b976-a12d-452d-8841-b2a09d7836bb tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10" status: 404 len: 111 microversion: 2.1 time: 0.030601 Aug 04 21:59:27.289799 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 601/1210] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:59:27 2022] GET /compute/v2.1/servers/14c3d2d2-5c7d-4f15-80c9-7cdc84595f10 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:59:28.647769 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4d543c8c-7fcb-47f4-9a48-e88788cdd50a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:28.648291 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4d543c8c-7fcb-47f4-9a48-e88788cdd50a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:28.654983 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d543c8c-7fcb-47f4-9a48-e88788cdd50a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:28.655459 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d543c8c-7fcb-47f4-9a48-e88788cdd50a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:28.655889 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d543c8c-7fcb-47f4-9a48-e88788cdd50a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:28.656569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d543c8c-7fcb-47f4-9a48-e88788cdd50a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:28.657014 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d543c8c-7fcb-47f4-9a48-e88788cdd50a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:28.657433 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4d543c8c-7fcb-47f4-9a48-e88788cdd50a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:28.671350 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-4d543c8c-7fcb-47f4-9a48-e88788cdd50a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] HTTP exception thrown: Instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 could not be found. Aug 04 21:59:28.672866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4d543c8c-7fcb-47f4-9a48-e88788cdd50a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Request method failure captured: Aug 04 21:59:28.672866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: DELETE /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 HTTP/1.1 Aug 04 21:59:28.672866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:59:28.672866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:59:28.672866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:59:28.672866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:59:28.672866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:59:28.672866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:59:28.672866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:59:28.672866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:59:28.672866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7D9t8rsKG84MG-XeY6Nlc6oGUGTGzOn1qsEfIgp1-xWWIq9149YutAj8rytKzxl4OvY1D-ym8-Nqng1af7gQx4CCQV_83zm6k1TU_HYRQtFUyhCDmnq8eGjcIc6yEaD-_4bsQnyh21Y-tgkQxsJlI6-_LY5y9tnue57bh7Fq5uafa0U Aug 04 21:59:28.672866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:59:28.672866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:59:28.672866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:59:28.672866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:59:28.672866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:59:28.672866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:59:28.672866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:59:28.672866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:28.672866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:59:28.672866 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:59:28.674518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8c4ab3c7309249228e42c226277fb14f", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:59:28.674518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:28.674518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:59:28.674518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:28.674518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:59:28.674518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:59:28.674518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:59:28.674518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: a022ce50f3334e919dcf0008bb6afcf8 Aug 04 21:59:28.674518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:59:28.674518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 21:59:28.674518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 could not be found. Aug 04 21:59:28.674518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': '1f9071d4-b230-4be2-aadd-ef84b2cd0e39'} Aug 04 21:59:28.676251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:59:28.676251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:28.676251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:59:28.676251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:59:28.676251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:59:28.676251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:59:28.676251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:59:28.676251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:59:28.676251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:59:28.676251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:59:28.676251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 could not be found. Aug 04 21:59:28.676251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:28.676251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:28.676251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:28.676251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:28.676251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:28.676251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:28.676251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:59:28.676251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:59:28.676251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:59:28.677765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:59:28.677765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:59:28.677765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:59:28.677765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:59:28.677765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:59:28.677765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:59:28.677765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:59:28.677765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:59:28.677765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:59:28.677765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 could not be found. Aug 04 21:59:28.677765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:28.677765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:28.677765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:28.677765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:28.677765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:28.677765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:28.677765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:59:28.677765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:59:28.677765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 could not be found. Aug 04 21:59:28.677765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:28.679206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4d543c8c-7fcb-47f4-9a48-e88788cdd50a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Returning 404 to user: Instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:59:28.679206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4d543c8c-7fcb-47f4-9a48-e88788cdd50a tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 404 len: 111 microversion: 2.1 time: 0.030407 Aug 04 21:59:28.679206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 610/1211] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 21:59:28 2022] DELETE /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:59:28.682719 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-67b93ca8-8f10-4f22-b130-168fce5c6304 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:28.684000 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-67b93ca8-8f10-4f22-b130-168fce5c6304 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] [instance: 1f9071d4-b230-4be2-aadd-ef84b2cd0e39] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:59:28.690603 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-67b93ca8-8f10-4f22-b130-168fce5c6304 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:28.691085 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-67b93ca8-8f10-4f22-b130-168fce5c6304 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:28.691515 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-67b93ca8-8f10-4f22-b130-168fce5c6304 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:28.692201 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-67b93ca8-8f10-4f22-b130-168fce5c6304 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:59:28.692674 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-67b93ca8-8f10-4f22-b130-168fce5c6304 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:59:28.693094 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-67b93ca8-8f10-4f22-b130-168fce5c6304 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:59:28.706697 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-67b93ca8-8f10-4f22-b130-168fce5c6304 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] HTTP exception thrown: Instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 could not be found. Aug 04 21:59:28.708192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-67b93ca8-8f10-4f22-b130-168fce5c6304 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Request method failure captured: Aug 04 21:59:28.708192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 HTTP/1.1 Aug 04 21:59:28.708192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:59:28.708192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:59:28.708192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:59:28.708192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 21:59:28.708192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:59:28.708192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:59:28.708192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:59:28.708192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:59:28.708192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7D9t8rsKG84MG-XeY6Nlc6oGUGTGzOn1qsEfIgp1-xWWIq9149YutAj8rytKzxl4OvY1D-ym8-Nqng1af7gQx4CCQV_83zm6k1TU_HYRQtFUyhCDmnq8eGjcIc6yEaD-_4bsQnyh21Y-tgkQxsJlI6-_LY5y9tnue57bh7Fq5uafa0U Aug 04 21:59:28.708192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:59:28.708192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:59:28.708192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:59:28.708192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:59:28.708192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:59:28.708192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:59:28.708192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:59:28.708192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:28.708192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:59:28.708192 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:59:28.709759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8c4ab3c7309249228e42c226277fb14f", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8c4ab3c7309249228e42c226277fb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:59:28.709759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:28.709759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: 8c4ab3c7309249228e42c226277fb14f Aug 04 21:59:28.709759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1469050598 Aug 04 21:59:28.709759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:59:28.709759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:59:28.709759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:59:28.709759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: a022ce50f3334e919dcf0008bb6afcf8 Aug 04 21:59:28.709759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-AttachVolumeNegativeTest-1469050598-project Aug 04 21:59:28.709759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 21:59:28.709759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 could not be found. Aug 04 21:59:28.709759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': '1f9071d4-b230-4be2-aadd-ef84b2cd0e39'} Aug 04 21:59:28.710866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:59:28.710866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:28.710866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:59:28.710866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:59:28.710866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:59:28.710866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:59:28.710866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:59:28.710866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:59:28.710866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:59:28.710866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:59:28.710866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 could not be found. Aug 04 21:59:28.710866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:28.710866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:28.710866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:28.710866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:28.710866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:28.710866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:28.710866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:59:28.710866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:59:28.710866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:59:28.712398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:59:28.712398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:59:28.712398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:59:28.712398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:59:28.712398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:59:28.712398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:59:28.712398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:59:28.712398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 could not be found. Aug 04 21:59:28.712398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:28.712398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:28.712398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:28.712398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:28.712398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:28.712398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:28.712398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:59:28.712398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:59:28.712398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 could not be found. Aug 04 21:59:28.712398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:28.715169 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-67b93ca8-8f10-4f22-b130-168fce5c6304 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] Returning 404 to user: Instance 1f9071d4-b230-4be2-aadd-ef84b2cd0e39 could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:59:28.715169 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-67b93ca8-8f10-4f22-b130-168fce5c6304 tempest-AttachVolumeNegativeTest-1469050598 tempest-AttachVolumeNegativeTest-1469050598-project] 10.222.0.73 "GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39" status: 404 len: 111 microversion: 2.1 time: 0.030695 Aug 04 21:59:28.715169 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 602/1212] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 21:59:28 2022] GET /compute/v2.1/servers/1f9071d4-b230-4be2-aadd-ef84b2cd0e39 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:59:34.597394 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a79fe5ff-6393-4164-b0b2-378f0785559a tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] Action: 'create', calling method: .version_select at 0x7f3c10f6cf70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-231045099", "metadata": {"Type": "work"}}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:59:34.607171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a79fe5ff-6393-4164-b0b2-378f0785559a tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] Request method failure captured: Aug 04 21:59:34.607171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 21:59:34.607171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:59:34.607171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:59:34.607171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:59:34.607171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 121 Aug 04 21:59:34.607171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:59:34.607171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:59:34.607171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:59:34.607171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:59:34.607171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7EFG84c1gsg8rkZl7S-RigRBUIL1nWgIzhqLlUGu9-zUKzTmARLMavu4wkv9SGNuwdDtZnxclGzWPva1DOpCAjP2Qd1pr3LuYGZ7XZo5AQlqA_xa1vE51eapdbvUCBgfSqmwf1YNsfNXF6hglmp5MZ1fRm0-BxPJ8HUnC00HUnw5ses Aug 04 21:59:34.607171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:59:34.607171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:59:34.607171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:59:34.607171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:59:34.607171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:59:34.607171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:59:34.607171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: a7845a49a73548b9ab451c89c21c91e2 Aug 04 21:59:34.607171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-VolumesNegativeTest-615337651 Aug 04 21:59:34.607171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:59:34.607171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:59:34.609052 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a7845a49a73548b9ab451c89c21c91e2", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a7845a49a73548b9ab451c89c21c91e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a7845a49a73548b9ab451c89c21c91e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a7845a49a73548b9ab451c89c21c91e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:59:34.609052 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-VolumesNegativeTest-615337651 Aug 04 21:59:34.609052 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: a7845a49a73548b9ab451c89c21c91e2 Aug 04 21:59:34.609052 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-VolumesNegativeTest-615337651 Aug 04 21:59:34.609052 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-VolumesNegativeTest-615337651-project Aug 04 21:59:34.609052 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:59:34.609052 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:59:34.609052 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: 217141cdd3a647f78fb99c391a2f431d Aug 04 21:59:34.609052 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-VolumesNegativeTest-615337651-project Aug 04 21:59:34.609052 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Aug 04 21:59:34.609052 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-231045099", "metadata": {"Type": "work"}}} Aug 04 21:59:34.609052 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: Aug 04 21:59:34.609052 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-231045099', 'metadata': {'Type': 'work'}}}} Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise error Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi '#$%' Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:59:34.610030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:59:34.611572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:59:34.611572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:59:34.611572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:59:34.611572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:59:34.611572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 21:59:34.611572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 21:59:34.611572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 21:59:34.611572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 21:59:34.611572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 21:59:34.611572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 21:59:34.611572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 21:59:34.611572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.611572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:34.611572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.611572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:34.611572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:34.611572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:34.611572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 21:59:34.611572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 21:59:34.612881 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 21:59:34.612881 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.612881 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a79fe5ff-6393-4164-b0b2-378f0785559a tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:59:34.612881 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-a79fe5ff-6393-4164-b0b2-378f0785559a tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.133935 Aug 04 21:59:34.612881 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 611/1213] 10.222.0.73 () {60 vars in 1156 bytes} [Thu Aug 4 21:59:34 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:59:34.618718 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ccb0d00a-279f-41c6-b757-afc81a12ef35 tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] Action: 'create', calling method: .version_select at 0x7f3c107a21f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-160204743", "metadata": {"Type": "work"}}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:59:34.624308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ccb0d00a-279f-41c6-b757-afc81a12ef35 tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] Request method failure captured: Aug 04 21:59:34.624308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 21:59:34.624308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:59:34.624308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:59:34.624308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:59:34.624308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 119 Aug 04 21:59:34.624308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:59:34.624308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:59:34.624308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:59:34.624308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:59:34.624308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7EFG84c1gsg8rkZl7S-RigRBUIL1nWgIzhqLlUGu9-zUKzTmARLMavu4wkv9SGNuwdDtZnxclGzWPva1DOpCAjP2Qd1pr3LuYGZ7XZo5AQlqA_xa1vE51eapdbvUCBgfSqmwf1YNsfNXF6hglmp5MZ1fRm0-BxPJ8HUnC00HUnw5ses Aug 04 21:59:34.624308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:59:34.624308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:59:34.624308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:59:34.624308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:59:34.624308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:59:34.624308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:59:34.624308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: a7845a49a73548b9ab451c89c21c91e2 Aug 04 21:59:34.624308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-VolumesNegativeTest-615337651 Aug 04 21:59:34.624308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:59:34.624308 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:59:34.626055 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a7845a49a73548b9ab451c89c21c91e2", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a7845a49a73548b9ab451c89c21c91e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a7845a49a73548b9ab451c89c21c91e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a7845a49a73548b9ab451c89c21c91e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:59:34.626055 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-VolumesNegativeTest-615337651 Aug 04 21:59:34.626055 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: a7845a49a73548b9ab451c89c21c91e2 Aug 04 21:59:34.626055 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-VolumesNegativeTest-615337651 Aug 04 21:59:34.626055 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-VolumesNegativeTest-615337651-project Aug 04 21:59:34.626055 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:59:34.626055 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:59:34.626055 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: 217141cdd3a647f78fb99c391a2f431d Aug 04 21:59:34.626055 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-VolumesNegativeTest-615337651-project Aug 04 21:59:34.626055 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Aug 04 21:59:34.626055 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-160204743", "metadata": {"Type": "work"}}} Aug 04 21:59:34.626055 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: Aug 04 21:59:34.626055 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-160204743', 'metadata': {'Type': 'work'}}}} Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise error Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi '0' Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:59:34.627394 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:59:34.629211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:59:34.629211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:59:34.629211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:59:34.629211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:59:34.629211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 21:59:34.629211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 21:59:34.629211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 21:59:34.629211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 21:59:34.629211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 21:59:34.629211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 21:59:34.629211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 21:59:34.629211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.629211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:34.629211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.629211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:34.629211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:34.629211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:34.629211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 21:59:34.629211 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 21:59:34.630896 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 21:59:34.630896 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.630896 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ccb0d00a-279f-41c6-b757-afc81a12ef35 tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:59:34.630896 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ccb0d00a-279f-41c6-b757-afc81a12ef35 tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010995 Aug 04 21:59:34.630896 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 603/1214] 10.222.0.73 () {60 vars in 1156 bytes} [Thu Aug 4 21:59:34 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:59:34.635989 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-1440d2e1-c2f3-4c65-80e8-adf57d8768aa tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] Action: 'create', calling method: .version_select at 0x7f3c1109d1f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1811714567", "metadata": {"Type": "work"}}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:59:34.640899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-1440d2e1-c2f3-4c65-80e8-adf57d8768aa tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] Request method failure captured: Aug 04 21:59:34.640899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 21:59:34.640899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:59:34.640899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:59:34.640899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:59:34.640899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 119 Aug 04 21:59:34.640899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:59:34.640899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:59:34.640899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:59:34.640899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:59:34.640899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7EFG84c1gsg8rkZl7S-RigRBUIL1nWgIzhqLlUGu9-zUKzTmARLMavu4wkv9SGNuwdDtZnxclGzWPva1DOpCAjP2Qd1pr3LuYGZ7XZo5AQlqA_xa1vE51eapdbvUCBgfSqmwf1YNsfNXF6hglmp5MZ1fRm0-BxPJ8HUnC00HUnw5ses Aug 04 21:59:34.640899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:59:34.640899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:59:34.640899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:59:34.640899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:59:34.640899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:59:34.640899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:59:34.640899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: a7845a49a73548b9ab451c89c21c91e2 Aug 04 21:59:34.640899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-VolumesNegativeTest-615337651 Aug 04 21:59:34.640899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:59:34.640899 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:59:34.642638 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a7845a49a73548b9ab451c89c21c91e2", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a7845a49a73548b9ab451c89c21c91e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a7845a49a73548b9ab451c89c21c91e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a7845a49a73548b9ab451c89c21c91e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:59:34.642638 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-VolumesNegativeTest-615337651 Aug 04 21:59:34.642638 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: a7845a49a73548b9ab451c89c21c91e2 Aug 04 21:59:34.642638 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-VolumesNegativeTest-615337651 Aug 04 21:59:34.642638 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-VolumesNegativeTest-615337651-project Aug 04 21:59:34.642638 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:59:34.642638 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:59:34.642638 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: 217141cdd3a647f78fb99c391a2f431d Aug 04 21:59:34.642638 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-VolumesNegativeTest-615337651-project Aug 04 21:59:34.642638 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Aug 04 21:59:34.642638 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1811714567", "metadata": {"Type": "work"}}} Aug 04 21:59:34.642638 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: Aug 04 21:59:34.642638 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1811714567', 'metadata': {'Type': 'work'}}}} Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise error Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi '' Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:59:34.643657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:59:34.645376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:59:34.645376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:59:34.645376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:59:34.645376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:59:34.645376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 21:59:34.645376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 21:59:34.645376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 21:59:34.645376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 21:59:34.645376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 21:59:34.645376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 21:59:34.645376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 21:59:34.645376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.645376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:34.645376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.645376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:34.645376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:34.645376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:34.645376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 21:59:34.645376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 21:59:34.646980 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 21:59:34.646980 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.646980 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-1440d2e1-c2f3-4c65-80e8-adf57d8768aa tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:59:34.646980 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-1440d2e1-c2f3-4c65-80e8-adf57d8768aa tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010162 Aug 04 21:59:34.646980 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 612/1215] 10.222.0.73 () {60 vars in 1156 bytes} [Thu Aug 4 21:59:34 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:59:34.652458 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ccb6afc4-33bb-446a-8328-1b7fdc356a86 tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] Calling method '.version_select at 0x7f3c107ec430>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:34.681532 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-ccb6afc4-33bb-446a-8328-1b7fdc356a86 tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] HTTP exception thrown: Volume tempest-invalid-1925330430 could not be found. Aug 04 21:59:34.684136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ccb6afc4-33bb-446a-8328-1b7fdc356a86 tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] Request method failure captured: Aug 04 21:59:34.684136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1925330430 HTTP/1.1 Aug 04 21:59:34.684136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:59:34.684136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:59:34.684136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:59:34.684136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 21:59:34.684136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:59:34.684136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:59:34.684136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:59:34.684136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:59:34.684136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7EFG84c1gsg8rkZl7S-RigRBUIL1nWgIzhqLlUGu9-zUKzTmARLMavu4wkv9SGNuwdDtZnxclGzWPva1DOpCAjP2Qd1pr3LuYGZ7XZo5AQlqA_xa1vE51eapdbvUCBgfSqmwf1YNsfNXF6hglmp5MZ1fRm0-BxPJ8HUnC00HUnw5ses Aug 04 21:59:34.684136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:59:34.684136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:59:34.684136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:59:34.684136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:59:34.684136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:59:34.684136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:59:34.684136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: a7845a49a73548b9ab451c89c21c91e2 Aug 04 21:59:34.684136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-VolumesNegativeTest-615337651 Aug 04 21:59:34.684136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:59:34.684136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:59:34.686122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a7845a49a73548b9ab451c89c21c91e2", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a7845a49a73548b9ab451c89c21c91e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a7845a49a73548b9ab451c89c21c91e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a7845a49a73548b9ab451c89c21c91e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:59:34.686122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-VolumesNegativeTest-615337651 Aug 04 21:59:34.686122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: a7845a49a73548b9ab451c89c21c91e2 Aug 04 21:59:34.686122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-VolumesNegativeTest-615337651 Aug 04 21:59:34.686122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-VolumesNegativeTest-615337651-project Aug 04 21:59:34.686122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:59:34.686122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:59:34.686122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: 217141cdd3a647f78fb99c391a2f431d Aug 04 21:59:34.686122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-VolumesNegativeTest-615337651-project Aug 04 21:59:34.686122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: Aug 04 21:59:34.686122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Volume tempest-invalid-1925330430 could not be found. Aug 04 21:59:34.686122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': 'tempest-invalid-1925330430'} Aug 04 21:59:34.686122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:59:34.687267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:34.687267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:59:34.687267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:59:34.687267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 21:59:34.687267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 21:59:34.687267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 21:59:34.687267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 21:59:34.687267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 21:59:34.687267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 21:59:34.687267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 21:59:34.687267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 21:59:34.687267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:59:34.687267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:59:34.687267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:59:34.687267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:59:34.687267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1925330430 could not be found. (HTTP 404) (Request-ID: req-0fe302de-6a6b-4bbf-9242-d10ee6424958) Aug 04 21:59:34.687267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.687267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:34.687267 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.688792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:34.688792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 21:59:34.688792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 21:59:34.688792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:59:34.688792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:59:34.688792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 21:59:34.688792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 21:59:34.688792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:59:34.688792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:59:34.688792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:59:34.688792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:59:34.688792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 21:59:34.688792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 21:59:34.688792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 21:59:34.688792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 21:59:34.688792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 21:59:34.688792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 21:59:34.688792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 21:59:34.688792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 21:59:34.690151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:59:34.690151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:59:34.690151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:59:34.690151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:59:34.690151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1925330430 could not be found. Aug 04 21:59:34.690151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.690151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:34.690151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.690151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:34.690151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:34.690151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:34.690151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:59:34.690151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:59:34.690151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:59:34.690151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:59:34.690151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:59:34.690151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:59:34.690151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 21:59:34.690151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:59:34.690151 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1925330430 could not be found. Aug 04 21:59:34.691812 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.691812 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:34.691812 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.691812 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:34.691812 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:34.691812 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:34.691812 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:59:34.691812 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:59:34.691812 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1925330430 could not be found. Aug 04 21:59:34.691812 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.691812 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ccb6afc4-33bb-446a-8328-1b7fdc356a86 tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] Returning 404 to user: Volume tempest-invalid-1925330430 could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:59:34.691812 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ccb6afc4-33bb-446a-8328-1b7fdc356a86 tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1925330430" status: 404 len: 99 microversion: 2.1 time: 0.037601 Aug 04 21:59:34.691812 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 604/1216] 10.222.0.73 () {58 vars in 1218 bytes} [Thu Aug 4 21:59:34 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1925330430 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 21:59:34.695171 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-77568892-fd64-4bc7-9e95-82d0fd209201 tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003808 Aug 04 21:59:34.695707 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 613/1217] 10.222.0.73 () {58 vars in 1140 bytes} [Thu Aug 4 21:59:34 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 21:59:34.704677 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-111442af-e7cb-49b0-93be-3daa23cbf3f6 tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003707 Aug 04 21:59:34.705163 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 605/1218] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 4 21:59:34 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 21:59:34.713410 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ca660fce-c859-467c-ad11-ad21cd4c461a tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] Calling method '.version_select at 0x7f3c10fcb160>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:34.744552 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-ca660fce-c859-467c-ad11-ad21cd4c461a tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] HTTP exception thrown: Volume 3b8cb373-6849-4d8c-85b1-6189e1d73e0e could not be found. Aug 04 21:59:34.753419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ca660fce-c859-467c-ad11-ad21cd4c461a tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] Request method failure captured: Aug 04 21:59:34.753419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: DELETE /compute/v2.1/os-volumes/3b8cb373-6849-4d8c-85b1-6189e1d73e0e HTTP/1.1 Aug 04 21:59:34.753419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 21:59:34.753419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 21:59:34.753419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 21:59:34.753419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 21:59:34.753419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 21:59:34.753419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 21:59:34.753419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 21:59:34.753419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 21:59:34.753419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7EFG84c1gsg8rkZl7S-RigRBUIL1nWgIzhqLlUGu9-zUKzTmARLMavu4wkv9SGNuwdDtZnxclGzWPva1DOpCAjP2Qd1pr3LuYGZ7XZo5AQlqA_xa1vE51eapdbvUCBgfSqmwf1YNsfNXF6hglmp5MZ1fRm0-BxPJ8HUnC00HUnw5ses Aug 04 21:59:34.753419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 21:59:34.753419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 21:59:34.753419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 21:59:34.753419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 21:59:34.753419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 21:59:34.753419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 21:59:34.753419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: a7845a49a73548b9ab451c89c21c91e2 Aug 04 21:59:34.753419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-VolumesNegativeTest-615337651 Aug 04 21:59:34.753419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 21:59:34.753419 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 21:59:34.755141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a7845a49a73548b9ab451c89c21c91e2", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a7845a49a73548b9ab451c89c21c91e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a7845a49a73548b9ab451c89c21c91e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a7845a49a73548b9ab451c89c21c91e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:59:34.755141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-VolumesNegativeTest-615337651 Aug 04 21:59:34.755141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: a7845a49a73548b9ab451c89c21c91e2 Aug 04 21:59:34.755141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-VolumesNegativeTest-615337651 Aug 04 21:59:34.755141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-VolumesNegativeTest-615337651-project Aug 04 21:59:34.755141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 21:59:34.755141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 21:59:34.755141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: 217141cdd3a647f78fb99c391a2f431d Aug 04 21:59:34.755141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-VolumesNegativeTest-615337651-project Aug 04 21:59:34.755141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: Aug 04 21:59:34.755141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Volume 3b8cb373-6849-4d8c-85b1-6189e1d73e0e could not be found. Aug 04 21:59:34.755141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': '3b8cb373-6849-4d8c-85b1-6189e1d73e0e'} Aug 04 21:59:34.755141 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:59:34.756107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:34.756107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:59:34.756107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:59:34.756107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 21:59:34.756107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 21:59:34.756107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 21:59:34.756107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 21:59:34.756107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 21:59:34.756107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 21:59:34.756107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 21:59:34.756107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 21:59:34.756107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:59:34.756107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:59:34.756107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:59:34.756107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:59:34.756107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b8cb373-6849-4d8c-85b1-6189e1d73e0e could not be found. (HTTP 404) (Request-ID: req-39f57452-f487-4fa7-8a1b-4b089ee92802) Aug 04 21:59:34.756107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.756107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:34.756107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.757593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:34.757593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 21:59:34.757593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 21:59:34.757593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:59:34.757593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:59:34.757593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 21:59:34.757593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 21:59:34.757593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:59:34.757593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:59:34.757593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:59:34.757593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:59:34.757593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 21:59:34.757593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 21:59:34.757593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 21:59:34.757593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 21:59:34.757593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 21:59:34.757593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 21:59:34.757593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 21:59:34.757593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 21:59:34.759231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:59:34.759231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:59:34.759231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:59:34.759231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:59:34.759231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b8cb373-6849-4d8c-85b1-6189e1d73e0e could not be found. Aug 04 21:59:34.759231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.759231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:34.759231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.759231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:34.759231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:34.759231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:34.759231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:59:34.759231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:59:34.759231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:59:34.759231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:59:34.759231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:59:34.759231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:59:34.759231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 21:59:34.759231 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:59:34.760782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b8cb373-6849-4d8c-85b1-6189e1d73e0e could not be found. Aug 04 21:59:34.760782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.760782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:34.760782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.760782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:34.760782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:34.760782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:34.760782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:59:34.760782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:59:34.760782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b8cb373-6849-4d8c-85b1-6189e1d73e0e could not be found. Aug 04 21:59:34.760782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.760782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ca660fce-c859-467c-ad11-ad21cd4c461a tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] Returning 404 to user: Volume 3b8cb373-6849-4d8c-85b1-6189e1d73e0e could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:59:34.760782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ca660fce-c859-467c-ad11-ad21cd4c461a tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/3b8cb373-6849-4d8c-85b1-6189e1d73e0e" status: 404 len: 109 microversion: 2.1 time: 0.038635 Aug 04 21:59:34.760782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 614/1219] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 4 21:59:34 2022] DELETE /compute/v2.1/os-volumes/3b8cb373-6849-4d8c-85b1-6189e1d73e0e => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:59:34.762598 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e08828ab-fdba-44d6-8bf5-05490ae4cf2b tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] Calling method '.version_select at 0x7f3c1257e4c0>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:59:34.791139 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-e08828ab-fdba-44d6-8bf5-05490ae4cf2b tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] HTTP exception thrown: Volume ae93409e-e055-477c-88a3-42033d1eb89e could not be found. Aug 04 21:59:34.793924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e08828ab-fdba-44d6-8bf5-05490ae4cf2b tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] Request method failure captured: Aug 04 21:59:34.793924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: GET /compute/v2.1/os-volumes/ae93409e-e055-477c-88a3-42033d1eb89e HTTP/1.1 Aug 04 21:59:34.793924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 21:59:34.793924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 21:59:34.793924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 21:59:34.793924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 21:59:34.793924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 21:59:34.793924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 21:59:34.793924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 21:59:34.793924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 21:59:34.793924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7EFG84c1gsg8rkZl7S-RigRBUIL1nWgIzhqLlUGu9-zUKzTmARLMavu4wkv9SGNuwdDtZnxclGzWPva1DOpCAjP2Qd1pr3LuYGZ7XZo5AQlqA_xa1vE51eapdbvUCBgfSqmwf1YNsfNXF6hglmp5MZ1fRm0-BxPJ8HUnC00HUnw5ses Aug 04 21:59:34.793924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 21:59:34.793924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 21:59:34.793924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 21:59:34.793924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 21:59:34.793924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 21:59:34.793924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 21:59:34.793924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: a7845a49a73548b9ab451c89c21c91e2 Aug 04 21:59:34.793924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-VolumesNegativeTest-615337651 Aug 04 21:59:34.793924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 21:59:34.793924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 21:59:34.795709 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a7845a49a73548b9ab451c89c21c91e2", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a7845a49a73548b9ab451c89c21c91e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a7845a49a73548b9ab451c89c21c91e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a7845a49a73548b9ab451c89c21c91e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 21:59:34.795709 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-VolumesNegativeTest-615337651 Aug 04 21:59:34.795709 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: a7845a49a73548b9ab451c89c21c91e2 Aug 04 21:59:34.795709 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-VolumesNegativeTest-615337651 Aug 04 21:59:34.795709 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-VolumesNegativeTest-615337651-project Aug 04 21:59:34.795709 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 21:59:34.795709 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 21:59:34.795709 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: 217141cdd3a647f78fb99c391a2f431d Aug 04 21:59:34.795709 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-VolumesNegativeTest-615337651-project Aug 04 21:59:34.795709 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: Aug 04 21:59:34.795709 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Volume ae93409e-e055-477c-88a3-42033d1eb89e could not be found. Aug 04 21:59:34.795709 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': 'ae93409e-e055-477c-88a3-42033d1eb89e'} Aug 04 21:59:34.795709 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:59:34.796939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:34.796939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:59:34.796939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:59:34.796939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:59:34.796939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:59:34.796939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:59:34.796939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:59:34.796939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:59:34.796939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:59:34.796939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:59:34.796939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:59:34.796939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:59:34.796939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:59:34.796939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:59:34.796939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:59:34.796939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ae93409e-e055-477c-88a3-42033d1eb89e could not be found. (HTTP 404) (Request-ID: req-a78b142a-f602-42e9-93e6-aa846eaf307a) Aug 04 21:59:34.796939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.796939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:34.796939 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.798514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:34.798514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 21:59:34.798514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 21:59:34.798514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:59:34.798514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:59:34.798514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 21:59:34.798514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 21:59:34.798514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:59:34.798514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:59:34.798514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:59:34.798514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:59:34.798514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:59:34.798514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:59:34.798514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:59:34.798514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:59:34.798514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:59:34.798514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:59:34.798514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:59:34.798514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:59:34.799998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:59:34.799998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:59:34.799998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:59:34.799998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:59:34.799998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ae93409e-e055-477c-88a3-42033d1eb89e could not be found. Aug 04 21:59:34.799998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.799998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:34.799998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.799998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:34.799998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:34.799998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:34.799998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:59:34.799998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:59:34.799998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:59:34.799998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:59:34.799998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:59:34.799998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:59:34.799998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 21:59:34.799998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:59:34.801496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ae93409e-e055-477c-88a3-42033d1eb89e could not be found. Aug 04 21:59:34.801496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.801496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:59:34.801496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.801496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:59:34.801496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:59:34.801496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:59:34.801496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:59:34.801496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:59:34.801496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ae93409e-e055-477c-88a3-42033d1eb89e could not be found. Aug 04 21:59:34.801496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 21:59:34.801496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-e08828ab-fdba-44d6-8bf5-05490ae4cf2b tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] Returning 404 to user: Volume ae93409e-e055-477c-88a3-42033d1eb89e could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:59:34.801496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-e08828ab-fdba-44d6-8bf5-05490ae4cf2b tempest-VolumesNegativeTest-615337651 tempest-VolumesNegativeTest-615337651-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/ae93409e-e055-477c-88a3-42033d1eb89e" status: 404 len: 109 microversion: 2.1 time: 0.036721 Aug 04 21:59:34.801496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 606/1220] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 4 21:59:34 2022] GET /compute/v2.1/os-volumes/ae93409e-e055-477c-88a3-42033d1eb89e => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 22:00:35.186391 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:00:35.187070 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Thu Aug 4 22:00:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:00:54.261807 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:00:54.262712 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:00:54.266932 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-cc507614-3232-416b-a2b9-fe661c99acff tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1043494769", "imageRef": "fca0c9ba-fb0a-4f30-932f-84d5253674ad", "flavorRef": "452", "networks": [{"uuid": "3edb4f2d-080b-426f-9239-6ed63cc0b663"}]}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:00:54.518488 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.network.neutron [None req-cc507614-3232-416b-a2b9-fe661c99acff tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] validate_networks() for [('3edb4f2d-080b-426f-9239-6ed63cc0b663', None, None, None, None, None)] {{(pid=136342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:00:54.935041 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-cc507614-3232-416b-a2b9-fe661c99acff tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Flavor limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:00:54.935466 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-cc507614-3232-416b-a2b9-fe661c99acff tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Image limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:00:54.935940 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-cc507614-3232-416b-a2b9-fe661c99acff tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Flavor pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:00:54.936360 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-cc507614-3232-416b-a2b9-fe661c99acff tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Image pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:00:54.936771 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-cc507614-3232-416b-a2b9-fe661c99acff tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:00:54.946020 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cc507614-3232-416b-a2b9-fe661c99acff tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:00:54.946516 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cc507614-3232-416b-a2b9-fe661c99acff tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:00:54.946952 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cc507614-3232-416b-a2b9-fe661c99acff tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:00:54.947675 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cc507614-3232-416b-a2b9-fe661c99acff tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:00:54.948138 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cc507614-3232-416b-a2b9-fe661c99acff tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:00:54.948563 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-cc507614-3232-416b-a2b9-fe661c99acff tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:00:54.966524 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-cc507614-3232-416b-a2b9-fe661c99acff tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Getting quotas for project 0e75154a4e9e4562b0757fc22af26d1e. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:00:54.970518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-cc507614-3232-416b-a2b9-fe661c99acff tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Getting quotas for user 037873250f324a82ba88d4ee151bfa2e and project 0e75154a4e9e4562b0757fc22af26d1e. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:00:54.982765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-cc507614-3232-416b-a2b9-fe661c99acff tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Going to run 1 instances... {{(pid=136342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:00:54.985046 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-cc507614-3232-416b-a2b9-fe661c99acff tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca0c9ba-fb0a-4f30-932f-84d5253674ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:00:55.176923 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-cc507614-3232-416b-a2b9-fe661c99acff tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.917259 Aug 04 22:00:55.182058 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 615/1221] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 4 22:00:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 22:00:55.189923 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:00:55.190707 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:00:55.195035 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d7a0b92d-80d7-49ab-8c67-4cc0bcd5f0eb tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:00:55.195649 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-d7a0b92d-80d7-49ab-8c67-4cc0bcd5f0eb tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:00:55.309438 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d7a0b92d-80d7-49ab-8c67-4cc0bcd5f0eb tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:00:55.316563 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d7a0b92d-80d7-49ab-8c67-4cc0bcd5f0eb tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55" status: 200 len: 1219 microversion: 2.1 time: 0.130783 Aug 04 22:00:55.317142 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 607/1222] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:00:55 2022] GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55 => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:00:56.337917 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8903a067-1ff2-43a6-938f-e25017765dbe tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:00:56.338512 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8903a067-1ff2-43a6-938f-e25017765dbe tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:00:56.345359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8903a067-1ff2-43a6-938f-e25017765dbe tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:00:56.345838 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8903a067-1ff2-43a6-938f-e25017765dbe tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:00:56.346298 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8903a067-1ff2-43a6-938f-e25017765dbe tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:00:56.346994 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8903a067-1ff2-43a6-938f-e25017765dbe tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:00:56.347441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8903a067-1ff2-43a6-938f-e25017765dbe tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:00:56.347857 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8903a067-1ff2-43a6-938f-e25017765dbe tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:00:56.412170 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8903a067-1ff2-43a6-938f-e25017765dbe tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:00:56.424859 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8903a067-1ff2-43a6-938f-e25017765dbe tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55" status: 200 len: 1223 microversion: 2.1 time: 0.090986 Aug 04 22:00:56.425434 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 616/1223] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:00:56 2022] GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:00:57.446979 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-204d36a0-217a-4f12-a71c-d7fd099f1323 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:00:57.447574 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-204d36a0-217a-4f12-a71c-d7fd099f1323 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:00:57.455748 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-204d36a0-217a-4f12-a71c-d7fd099f1323 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:00:57.456231 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-204d36a0-217a-4f12-a71c-d7fd099f1323 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:00:57.456704 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-204d36a0-217a-4f12-a71c-d7fd099f1323 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:00:57.457397 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-204d36a0-217a-4f12-a71c-d7fd099f1323 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:00:57.457846 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-204d36a0-217a-4f12-a71c-d7fd099f1323 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:00:57.458292 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-204d36a0-217a-4f12-a71c-d7fd099f1323 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:00:57.523169 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-204d36a0-217a-4f12-a71c-d7fd099f1323 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:00:57.532938 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-204d36a0-217a-4f12-a71c-d7fd099f1323 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55" status: 200 len: 1279 microversion: 2.1 time: 0.090667 Aug 04 22:00:57.533759 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 608/1224] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:00:57 2022] GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55 => generated 1279 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:00:58.554522 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-c76d9863-1534-4215-914f-0a3779231ab4 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:00:58.555139 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-c76d9863-1534-4215-914f-0a3779231ab4 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:00:58.562054 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c76d9863-1534-4215-914f-0a3779231ab4 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:00:58.562549 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c76d9863-1534-4215-914f-0a3779231ab4 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:00:58.562986 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c76d9863-1534-4215-914f-0a3779231ab4 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:00:58.563685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c76d9863-1534-4215-914f-0a3779231ab4 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:00:58.564139 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c76d9863-1534-4215-914f-0a3779231ab4 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:00:58.564658 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c76d9863-1534-4215-914f-0a3779231ab4 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:00:58.777602 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-c76d9863-1534-4215-914f-0a3779231ab4 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:00:58.785939 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-c76d9863-1534-4215-914f-0a3779231ab4 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55" status: 200 len: 1319 microversion: 2.1 time: 0.235255 Aug 04 22:00:58.786554 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 617/1225] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:00:58 2022] GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:00:59.256716 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-c2f535f7-46c7-493d-b3b0-2fbae6ba5d54 req-bccfeaf2-e7c0-45eb-bd85-e777b552aeaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa39858-9346-44f0-860c-715283f9fa55", "tag": "35202b9a-bcc6-4539-801a-53f490082518"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:00:59.265753 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-c2f535f7-46c7-493d-b3b0-2fbae6ba5d54 req-bccfeaf2-e7c0-45eb-bd85-e777b552aeaa service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:00:59.266265 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-c2f535f7-46c7-493d-b3b0-2fbae6ba5d54 req-bccfeaf2-e7c0-45eb-bd85-e777b552aeaa service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:00:59.266696 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-c2f535f7-46c7-493d-b3b0-2fbae6ba5d54 req-bccfeaf2-e7c0-45eb-bd85-e777b552aeaa service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:00:59.278611 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-c2f535f7-46c7-493d-b3b0-2fbae6ba5d54 req-bccfeaf2-e7c0-45eb-bd85-e777b552aeaa service nova] Creating event network-changed:35202b9a-bcc6-4539-801a-53f490082518 for instance daa39858-9346-44f0-860c-715283f9fa55 on hv-cinder-85220 Aug 04 22:00:59.283933 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-c2f535f7-46c7-493d-b3b0-2fbae6ba5d54 req-bccfeaf2-e7c0-45eb-bd85-e777b552aeaa service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033346 Aug 04 22:00:59.285481 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 609/1226] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 22:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:00:59.810483 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-05ed2f68-b0b6-489a-9562-2c8e9f0f8dca tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:00:59.811132 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-05ed2f68-b0b6-489a-9562-2c8e9f0f8dca tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:00:59.817964 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-05ed2f68-b0b6-489a-9562-2c8e9f0f8dca tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:00:59.818483 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-05ed2f68-b0b6-489a-9562-2c8e9f0f8dca tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:00:59.819109 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-05ed2f68-b0b6-489a-9562-2c8e9f0f8dca tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:00:59.820119 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-05ed2f68-b0b6-489a-9562-2c8e9f0f8dca tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:00:59.820584 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-05ed2f68-b0b6-489a-9562-2c8e9f0f8dca tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:00:59.821091 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-05ed2f68-b0b6-489a-9562-2c8e9f0f8dca tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:00.107048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-05ed2f68-b0b6-489a-9562-2c8e9f0f8dca tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:00.114915 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-05ed2f68-b0b6-489a-9562-2c8e9f0f8dca tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55" status: 200 len: 1319 microversion: 2.1 time: 0.308873 Aug 04 22:01:00.115494 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 618/1227] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:00:59 2022] GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55 => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:01.138019 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2f4d603f-9ec3-42fe-9047-beda86f69a42 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:01.138726 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-2f4d603f-9ec3-42fe-9047-beda86f69a42 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:01.145224 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f4d603f-9ec3-42fe-9047-beda86f69a42 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:01.145710 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f4d603f-9ec3-42fe-9047-beda86f69a42 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:01.146200 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f4d603f-9ec3-42fe-9047-beda86f69a42 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:01.146896 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f4d603f-9ec3-42fe-9047-beda86f69a42 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:01.147345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f4d603f-9ec3-42fe-9047-beda86f69a42 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:01.147764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2f4d603f-9ec3-42fe-9047-beda86f69a42 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:01.286824 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2f4d603f-9ec3-42fe-9047-beda86f69a42 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:01.294918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2f4d603f-9ec3-42fe-9047-beda86f69a42 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55" status: 200 len: 1319 microversion: 2.1 time: 0.161677 Aug 04 22:01:01.295478 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 610/1228] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:01 2022] GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:02.315142 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-7fdfc846-6955-44c8-a57a-aa6f4d772fa2 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:02.315758 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7fdfc846-6955-44c8-a57a-aa6f4d772fa2 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:02.322095 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7fdfc846-6955-44c8-a57a-aa6f4d772fa2 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:02.322572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7fdfc846-6955-44c8-a57a-aa6f4d772fa2 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:02.323000 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7fdfc846-6955-44c8-a57a-aa6f4d772fa2 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:02.323767 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7fdfc846-6955-44c8-a57a-aa6f4d772fa2 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:02.324216 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7fdfc846-6955-44c8-a57a-aa6f4d772fa2 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:02.324632 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7fdfc846-6955-44c8-a57a-aa6f4d772fa2 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:02.459522 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7fdfc846-6955-44c8-a57a-aa6f4d772fa2 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:02.467705 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-7fdfc846-6955-44c8-a57a-aa6f4d772fa2 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55" status: 200 len: 1319 microversion: 2.1 time: 0.156397 Aug 04 22:01:02.468265 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 619/1229] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:02 2022] GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:03.488668 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d86224a0-287d-46f2-86e3-95cdcf12d3c9 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:03.489245 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-d86224a0-287d-46f2-86e3-95cdcf12d3c9 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:03.496516 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d86224a0-287d-46f2-86e3-95cdcf12d3c9 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:03.497022 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d86224a0-287d-46f2-86e3-95cdcf12d3c9 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:03.497714 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d86224a0-287d-46f2-86e3-95cdcf12d3c9 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:03.498432 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d86224a0-287d-46f2-86e3-95cdcf12d3c9 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:03.498883 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d86224a0-287d-46f2-86e3-95cdcf12d3c9 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:03.499300 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d86224a0-287d-46f2-86e3-95cdcf12d3c9 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:03.633656 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d86224a0-287d-46f2-86e3-95cdcf12d3c9 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:03.642203 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d86224a0-287d-46f2-86e3-95cdcf12d3c9 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55" status: 200 len: 1319 microversion: 2.1 time: 0.157255 Aug 04 22:01:03.642784 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 611/1230] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:03 2022] GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:04.664178 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-565cb243-bd9b-4eaf-8555-70bda5383248 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:04.664799 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-565cb243-bd9b-4eaf-8555-70bda5383248 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:04.673084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-565cb243-bd9b-4eaf-8555-70bda5383248 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:04.674120 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-565cb243-bd9b-4eaf-8555-70bda5383248 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:04.674120 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-565cb243-bd9b-4eaf-8555-70bda5383248 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:04.675016 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-565cb243-bd9b-4eaf-8555-70bda5383248 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:04.675484 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-565cb243-bd9b-4eaf-8555-70bda5383248 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:04.675912 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-565cb243-bd9b-4eaf-8555-70bda5383248 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:04.812719 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-565cb243-bd9b-4eaf-8555-70bda5383248 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:04.820124 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-565cb243-bd9b-4eaf-8555-70bda5383248 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55" status: 200 len: 1319 microversion: 2.1 time: 0.160173 Aug 04 22:01:04.820682 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 620/1231] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:04 2022] GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:05.841366 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-5b746e40-050a-4f07-b60b-d102e1379005 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:05.841980 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-5b746e40-050a-4f07-b60b-d102e1379005 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:05.844527 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=2 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:01:05.849301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5b746e40-050a-4f07-b60b-d102e1379005 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:05.849787 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5b746e40-050a-4f07-b60b-d102e1379005 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:05.850396 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5b746e40-050a-4f07-b60b-d102e1379005 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:05.851168 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5b746e40-050a-4f07-b60b-d102e1379005 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:05.851626 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5b746e40-050a-4f07-b60b-d102e1379005 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:05.852179 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5b746e40-050a-4f07-b60b-d102e1379005 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:05.855967 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-f5850680-57d7-4c3a-b924-f691537a5f0d req-6e18a5cb-d3d6-4218-a8b7-0f522e41faf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa39858-9346-44f0-860c-715283f9fa55", "name": "network-vif-plugged", "status": "completed", "tag": "35202b9a-bcc6-4539-801a-53f490082518"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:01:05.863200 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=2 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:01:05.863879 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=6 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:01:05.869599 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-f5850680-57d7-4c3a-b924-f691537a5f0d req-6e18a5cb-d3d6-4218-a8b7-0f522e41faf2 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:05.870181 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-f5850680-57d7-4c3a-b924-f691537a5f0d req-6e18a5cb-d3d6-4218-a8b7-0f522e41faf2 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:05.871123 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-f5850680-57d7-4c3a-b924-f691537a5f0d req-6e18a5cb-d3d6-4218-a8b7-0f522e41faf2 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:05.882713 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-f5850680-57d7-4c3a-b924-f691537a5f0d req-6e18a5cb-d3d6-4218-a8b7-0f522e41faf2 service nova] Creating event network-vif-plugged:35202b9a-bcc6-4539-801a-53f490082518 for instance daa39858-9346-44f0-860c-715283f9fa55 on hv-cinder-85220 Aug 04 22:01:05.888472 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-f5850680-57d7-4c3a-b924-f691537a5f0d req-6e18a5cb-d3d6-4218-a8b7-0f522e41faf2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036713 Aug 04 22:01:05.889066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 621/1232] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 22:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:01:05.998717 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-5b746e40-050a-4f07-b60b-d102e1379005 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:06.006229 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-5b746e40-050a-4f07-b60b-d102e1379005 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55" status: 200 len: 1319 microversion: 2.1 time: 0.169271 Aug 04 22:01:06.006791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 612/1233] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:05 2022] GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:07.029387 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b97b5de7-ebc8-4d67-bea0-7c81ec6d9f3f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:07.030129 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b97b5de7-ebc8-4d67-bea0-7c81ec6d9f3f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:07.037388 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b97b5de7-ebc8-4d67-bea0-7c81ec6d9f3f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:07.037874 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b97b5de7-ebc8-4d67-bea0-7c81ec6d9f3f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:07.038346 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b97b5de7-ebc8-4d67-bea0-7c81ec6d9f3f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:07.039046 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b97b5de7-ebc8-4d67-bea0-7c81ec6d9f3f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:07.039498 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b97b5de7-ebc8-4d67-bea0-7c81ec6d9f3f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:07.039923 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b97b5de7-ebc8-4d67-bea0-7c81ec6d9f3f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:07.180095 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b97b5de7-ebc8-4d67-bea0-7c81ec6d9f3f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:07.187904 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b97b5de7-ebc8-4d67-bea0-7c81ec6d9f3f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55" status: 200 len: 1319 microversion: 2.1 time: 0.163936 Aug 04 22:01:07.188465 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 622/1234] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:07 2022] GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:08.209656 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c352a0f0-a896-482b-af93-8125e4c092da tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:08.210301 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c352a0f0-a896-482b-af93-8125e4c092da tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:08.217302 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c352a0f0-a896-482b-af93-8125e4c092da tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:08.217780 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c352a0f0-a896-482b-af93-8125e4c092da tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:08.218240 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c352a0f0-a896-482b-af93-8125e4c092da tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:08.218928 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c352a0f0-a896-482b-af93-8125e4c092da tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:08.219374 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c352a0f0-a896-482b-af93-8125e4c092da tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:08.219795 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c352a0f0-a896-482b-af93-8125e4c092da tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:08.352483 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-c352a0f0-a896-482b-af93-8125e4c092da tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:08.360755 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c352a0f0-a896-482b-af93-8125e4c092da tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55" status: 200 len: 1508 microversion: 2.1 time: 0.155052 Aug 04 22:01:08.361306 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 613/1235] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:08 2022] GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:30.273102 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-57c0b044-4663-44c3-9072-2d4f3277809f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f18f0411-cb56-491b-9de8-2ecba7583f0a", "device": "/dev/sdb"}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:01:30.275984 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-57c0b044-4663-44c3-9072-2d4f3277809f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:30.278747 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:01:30.279660 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=40 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:01:30.284348 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57c0b044-4663-44c3-9072-2d4f3277809f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:30.284831 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57c0b044-4663-44c3-9072-2d4f3277809f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:30.285265 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57c0b044-4663-44c3-9072-2d4f3277809f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:30.285961 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57c0b044-4663-44c3-9072-2d4f3277809f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:30.286444 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57c0b044-4663-44c3-9072-2d4f3277809f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:30.286868 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57c0b044-4663-44c3-9072-2d4f3277809f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:31.020155 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-57c0b044-4663-44c3-9072-2d4f3277809f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "POST /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.750916 Aug 04 22:01:31.020755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 623/1236] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 4 22:01:30 2022] POST /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55/os-volume_attachments => generated 194 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:01:31.877710 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c02b8bf1-4d23-44dd-99c8-57e28cf16387 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:31.878364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c02b8bf1-4d23-44dd-99c8-57e28cf16387 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:31.880247 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=16 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:01:31.880911 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=32 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:01:31.885687 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c02b8bf1-4d23-44dd-99c8-57e28cf16387 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:31.886230 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c02b8bf1-4d23-44dd-99c8-57e28cf16387 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:31.886663 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c02b8bf1-4d23-44dd-99c8-57e28cf16387 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:31.887352 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c02b8bf1-4d23-44dd-99c8-57e28cf16387 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:31.887793 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c02b8bf1-4d23-44dd-99c8-57e28cf16387 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:31.888238 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c02b8bf1-4d23-44dd-99c8-57e28cf16387 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:31.915455 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c02b8bf1-4d23-44dd-99c8-57e28cf16387 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Going to try to terminate instance {{(pid=136341) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:01:32.166873 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c02b8bf1-4d23-44dd-99c8-57e28cf16387 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 204 len: 0 microversion: 2.1 time: 0.293387 Aug 04 22:01:32.167465 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 614/1237] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 22:01:31 2022] DELETE /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:01:32.177160 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-05b6be7f-750f-44dd-804e-406368ede1a6 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:32.177852 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-05b6be7f-750f-44dd-804e-406368ede1a6 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:32.184187 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-05b6be7f-750f-44dd-804e-406368ede1a6 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:32.184665 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-05b6be7f-750f-44dd-804e-406368ede1a6 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:32.185094 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-05b6be7f-750f-44dd-804e-406368ede1a6 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:32.186496 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-05b6be7f-750f-44dd-804e-406368ede1a6 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:32.187033 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-05b6be7f-750f-44dd-804e-406368ede1a6 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:32.187412 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-05b6be7f-750f-44dd-804e-406368ede1a6 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:32.321806 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-05b6be7f-750f-44dd-804e-406368ede1a6 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:32.329489 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-05b6be7f-750f-44dd-804e-406368ede1a6 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1578 microversion: 2.1 time: 0.157131 Aug 04 22:01:32.330072 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 624/1238] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:32 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:33.351936 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d6fee349-8200-4683-b11b-f686da168ea5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:33.352688 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-d6fee349-8200-4683-b11b-f686da168ea5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:33.359281 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d6fee349-8200-4683-b11b-f686da168ea5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:33.365418 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d6fee349-8200-4683-b11b-f686da168ea5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:33.365418 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d6fee349-8200-4683-b11b-f686da168ea5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:33.365418 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d6fee349-8200-4683-b11b-f686da168ea5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:33.365418 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d6fee349-8200-4683-b11b-f686da168ea5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:33.365819 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d6fee349-8200-4683-b11b-f686da168ea5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:33.503342 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d6fee349-8200-4683-b11b-f686da168ea5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:33.511018 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d6fee349-8200-4683-b11b-f686da168ea5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1578 microversion: 2.1 time: 0.163247 Aug 04 22:01:33.511596 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 615/1239] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:33 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:34.532518 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-18fae988-1da3-4c32-88f4-10f51daf7998 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:34.533226 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-18fae988-1da3-4c32-88f4-10f51daf7998 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:34.539955 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-18fae988-1da3-4c32-88f4-10f51daf7998 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:34.540438 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-18fae988-1da3-4c32-88f4-10f51daf7998 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:34.540863 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-18fae988-1da3-4c32-88f4-10f51daf7998 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:34.541569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-18fae988-1da3-4c32-88f4-10f51daf7998 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:34.542029 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-18fae988-1da3-4c32-88f4-10f51daf7998 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:34.542449 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-18fae988-1da3-4c32-88f4-10f51daf7998 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:34.797603 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-18fae988-1da3-4c32-88f4-10f51daf7998 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:34.808644 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-18fae988-1da3-4c32-88f4-10f51daf7998 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1578 microversion: 2.1 time: 0.280262 Aug 04 22:01:34.812066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 625/1240] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:34 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1578 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:35.359504 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-0ef9162f-9747-48f5-bbb4-a54c3ffe45d6 req-67e3faa5-8017-4b82-8a6a-7ae0c5f58256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1de7b9b7-4e16-410d-aca1-86903eb1f8b6", "name": "network-vif-deleted", "tag": "04e22766-471e-404f-a467-46f2d75b7fe5"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:01:35.377274 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-0ef9162f-9747-48f5-bbb4-a54c3ffe45d6 req-67e3faa5-8017-4b82-8a6a-7ae0c5f58256 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:35.377844 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-0ef9162f-9747-48f5-bbb4-a54c3ffe45d6 req-67e3faa5-8017-4b82-8a6a-7ae0c5f58256 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:35.378383 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-0ef9162f-9747-48f5-bbb4-a54c3ffe45d6 req-67e3faa5-8017-4b82-8a6a-7ae0c5f58256 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:35.390806 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-0ef9162f-9747-48f5-bbb4-a54c3ffe45d6 req-67e3faa5-8017-4b82-8a6a-7ae0c5f58256 service nova] Creating event network-vif-deleted:04e22766-471e-404f-a467-46f2d75b7fe5 for instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 on hv-cinder-85220 Aug 04 22:01:35.396328 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-0ef9162f-9747-48f5-bbb4-a54c3ffe45d6 req-67e3faa5-8017-4b82-8a6a-7ae0c5f58256 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041539 Aug 04 22:01:35.397046 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 616/1241] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 22:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:01:35.830938 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-47f7de67-f835-4457-9c63-2f563ce9fec7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:35.831508 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-47f7de67-f835-4457-9c63-2f563ce9fec7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:35.837717 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-47f7de67-f835-4457-9c63-2f563ce9fec7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:35.838239 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-47f7de67-f835-4457-9c63-2f563ce9fec7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:35.838676 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-47f7de67-f835-4457-9c63-2f563ce9fec7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:35.839583 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-47f7de67-f835-4457-9c63-2f563ce9fec7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:35.840217 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-47f7de67-f835-4457-9c63-2f563ce9fec7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:35.840750 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-47f7de67-f835-4457-9c63-2f563ce9fec7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:35.906195 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-47f7de67-f835-4457-9c63-2f563ce9fec7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:35.914266 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-47f7de67-f835-4457-9c63-2f563ce9fec7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 200 len: 1226 microversion: 2.1 time: 0.087385 Aug 04 22:01:35.914830 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 626/1242] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:35 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:36.937760 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-02cf89e3-1474-46e3-ae2c-7982d75fe8ed tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:36.938493 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-02cf89e3-1474-46e3-ae2c-7982d75fe8ed tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:36.944636 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-02cf89e3-1474-46e3-ae2c-7982d75fe8ed tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:36.950189 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-02cf89e3-1474-46e3-ae2c-7982d75fe8ed tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:36.950189 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-02cf89e3-1474-46e3-ae2c-7982d75fe8ed tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:36.950189 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-02cf89e3-1474-46e3-ae2c-7982d75fe8ed tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:36.950189 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-02cf89e3-1474-46e3-ae2c-7982d75fe8ed tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:36.950653 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-02cf89e3-1474-46e3-ae2c-7982d75fe8ed tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:36.960642 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-02cf89e3-1474-46e3-ae2c-7982d75fe8ed tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] HTTP exception thrown: Instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 could not be found. Aug 04 22:01:36.962310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-02cf89e3-1474-46e3-ae2c-7982d75fe8ed tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Request method failure captured: Aug 04 22:01:36.962310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 HTTP/1.1 Aug 04 22:01:36.962310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 22:01:36.962310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 22:01:36.962310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 22:01:36.962310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 22:01:36.962310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 22:01:36.962310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 22:01:36.962310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 22:01:36.962310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 22:01:36.962310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7EDqbTAyqTRIYjx4djC2yo4r6IBfu-T360DNuVrxA5OTXLwG7tTMU9F3lk0Pk3MnG61_Pgmt7lJovXdP5naAlCZlqHJbYAO_mR72tWMo-XSgOpimooySbpHezQEPFrvTbrLiwwuHFd1Mfmu9Vh2lZv3ew60c9v054QOROat-lGRGWsI Aug 04 22:01:36.962310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 22:01:36.962310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 22:01:36.962310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 22:01:36.962310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 22:01:36.962310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 22:01:36.962310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 22:01:36.962310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: ee8894a750724fb987a01514be0ab39b Aug 04 22:01:36.962310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-TestVolumeBootPattern-1050826126 Aug 04 22:01:36.962310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 22:01:36.962310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 22:01:36.963965 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ee8894a750724fb987a01514be0ab39b", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ee8894a750724fb987a01514be0ab39b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee8894a750724fb987a01514be0ab39b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee8894a750724fb987a01514be0ab39b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 22:01:36.963965 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-TestVolumeBootPattern-1050826126 Aug 04 22:01:36.963965 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: ee8894a750724fb987a01514be0ab39b Aug 04 22:01:36.963965 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-TestVolumeBootPattern-1050826126 Aug 04 22:01:36.963965 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-TestVolumeBootPattern-1050826126-project Aug 04 22:01:36.963965 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 22:01:36.963965 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 22:01:36.963965 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: 292eee6c79214436962643db0a840708 Aug 04 22:01:36.963965 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-TestVolumeBootPattern-1050826126-project Aug 04 22:01:36.963965 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 22:01:36.963965 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 could not be found. Aug 04 22:01:36.963965 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': '1de7b9b7-4e16-410d-aca1-86903eb1f8b6'} Aug 04 22:01:36.965276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:01:36.965276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:01:36.965276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:01:36.965276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:01:36.965276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:01:36.965276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:01:36.965276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:01:36.965276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:01:36.965276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:01:36.965276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:01:36.965276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 could not be found. Aug 04 22:01:36.965276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 22:01:36.965276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:01:36.965276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 22:01:36.965276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:01:36.965276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:01:36.965276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:01:36.965276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:01:36.965276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:01:36.965276 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:01:36.967399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:01:36.967399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:01:36.967399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:01:36.967399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:01:36.967399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:01:36.967399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:01:36.967399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:01:36.967399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 could not be found. Aug 04 22:01:36.967399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 22:01:36.967399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:01:36.967399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 22:01:36.967399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:01:36.967399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:01:36.967399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:01:36.967399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:01:36.967399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:01:36.967399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 could not be found. Aug 04 22:01:36.967399 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 22:01:36.968910 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-02cf89e3-1474-46e3-ae2c-7982d75fe8ed tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Returning 404 to user: Instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:01:36.968910 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-02cf89e3-1474-46e3-ae2c-7982d75fe8ed tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 404 len: 111 microversion: 2.1 time: 0.031647 Aug 04 22:01:36.968910 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 617/1243] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:36 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:01:37.058886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-7116e106-4f4c-4973-8eac-8b9f6b9f36d5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-456873597", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1795731597", "security_groups": [{"name": "tempest-secgroup-smoke-965852390"}], "block_device_mapping_v2": [{"uuid": "24341af6-3dce-4121-887b-30657fab8e55", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4dc06773-9775-4bb6-a3f2-6c12854b5693"}]}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:01:37.175967 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.network.neutron [None req-7116e106-4f4c-4973-8eac-8b9f6b9f36d5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] validate_networks() for [('4dc06773-9775-4bb6-a3f2-6c12854b5693', None, None, None, None, None)] {{(pid=136342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:01:37.553494 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-7116e106-4f4c-4973-8eac-8b9f6b9f36d5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Flavor limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:01:37.553922 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-7116e106-4f4c-4973-8eac-8b9f6b9f36d5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Image limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:01:37.554435 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-7116e106-4f4c-4973-8eac-8b9f6b9f36d5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Flavor pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:01:37.554847 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-7116e106-4f4c-4973-8eac-8b9f6b9f36d5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Image pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:01:37.555292 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-7116e106-4f4c-4973-8eac-8b9f6b9f36d5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:01:37.564740 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7116e106-4f4c-4973-8eac-8b9f6b9f36d5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:37.565223 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7116e106-4f4c-4973-8eac-8b9f6b9f36d5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:37.565660 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7116e106-4f4c-4973-8eac-8b9f6b9f36d5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:37.566425 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7116e106-4f4c-4973-8eac-8b9f6b9f36d5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:37.567082 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7116e106-4f4c-4973-8eac-8b9f6b9f36d5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:37.567309 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7116e106-4f4c-4973-8eac-8b9f6b9f36d5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:37.583927 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-7116e106-4f4c-4973-8eac-8b9f6b9f36d5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Getting quotas for project ee8894a750724fb987a01514be0ab39b. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:01:37.587912 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-7116e106-4f4c-4973-8eac-8b9f6b9f36d5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Getting quotas for user 292eee6c79214436962643db0a840708 and project ee8894a750724fb987a01514be0ab39b. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:01:37.651226 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7116e106-4f4c-4973-8eac-8b9f6b9f36d5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Going to run 1 instances... {{(pid=136342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:01:37.653293 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7116e106-4f4c-4973-8eac-8b9f6b9f36d5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24341af6-3dce-4121-887b-30657fab8e55',volume_size=None,volume_type=None)] {{(pid=136342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:01:38.096820 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-7116e106-4f4c-4973-8eac-8b9f6b9f36d5 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.041642 Aug 04 22:01:38.098145 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 627/1244] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 4 22:01:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 22:01:38.113248 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-25f57171-4c17-4150-890a-6549eb19bfe1 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:38.113892 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-25f57171-4c17-4150-890a-6549eb19bfe1 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:38.178031 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-25f57171-4c17-4150-890a-6549eb19bfe1 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:38.185325 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-25f57171-4c17-4150-890a-6549eb19bfe1 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1094 microversion: 2.1 time: 0.076003 Aug 04 22:01:38.185897 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 618/1245] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:38 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:01:39.206494 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-ceaefa4e-ed11-4167-9839-73038cbf2660 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:39.207119 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-ceaefa4e-ed11-4167-9839-73038cbf2660 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:39.213755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ceaefa4e-ed11-4167-9839-73038cbf2660 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:39.214308 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ceaefa4e-ed11-4167-9839-73038cbf2660 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:39.214847 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ceaefa4e-ed11-4167-9839-73038cbf2660 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:39.215555 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ceaefa4e-ed11-4167-9839-73038cbf2660 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:39.216003 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ceaefa4e-ed11-4167-9839-73038cbf2660 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:39.216959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-ceaefa4e-ed11-4167-9839-73038cbf2660 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:39.279834 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-ceaefa4e-ed11-4167-9839-73038cbf2660 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:39.287366 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-ceaefa4e-ed11-4167-9839-73038cbf2660 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1144 microversion: 2.1 time: 0.085288 Aug 04 22:01:39.287991 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 628/1246] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:39 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:40.308984 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ab687bd7-6772-4b19-8230-0cdc5258692f tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:40.309733 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ab687bd7-6772-4b19-8230-0cdc5258692f tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:40.319181 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ab687bd7-6772-4b19-8230-0cdc5258692f tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:40.319703 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ab687bd7-6772-4b19-8230-0cdc5258692f tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:40.320136 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ab687bd7-6772-4b19-8230-0cdc5258692f tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:40.320834 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ab687bd7-6772-4b19-8230-0cdc5258692f tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:40.321289 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ab687bd7-6772-4b19-8230-0cdc5258692f tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:40.321814 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ab687bd7-6772-4b19-8230-0cdc5258692f tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:40.386974 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ab687bd7-6772-4b19-8230-0cdc5258692f tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:40.395043 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ab687bd7-6772-4b19-8230-0cdc5258692f tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1210 microversion: 2.1 time: 0.090301 Aug 04 22:01:40.395962 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 619/1247] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:40 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:41.416349 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8d0874c2-c9d4-4399-9d99-93c48f357d3e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:41.416900 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8d0874c2-c9d4-4399-9d99-93c48f357d3e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:41.424167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8d0874c2-c9d4-4399-9d99-93c48f357d3e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:41.424648 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8d0874c2-c9d4-4399-9d99-93c48f357d3e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:41.425073 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8d0874c2-c9d4-4399-9d99-93c48f357d3e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:41.425753 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8d0874c2-c9d4-4399-9d99-93c48f357d3e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:41.426232 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8d0874c2-c9d4-4399-9d99-93c48f357d3e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:41.426651 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8d0874c2-c9d4-4399-9d99-93c48f357d3e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:41.563697 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8d0874c2-c9d4-4399-9d99-93c48f357d3e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:41.571256 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8d0874c2-c9d4-4399-9d99-93c48f357d3e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1277 microversion: 2.1 time: 0.159234 Aug 04 22:01:41.571807 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 629/1248] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:41 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:42.597478 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-4d753fd8-d07a-4df7-8b84-496c07281ee6 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:42.598107 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-4d753fd8-d07a-4df7-8b84-496c07281ee6 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:42.604454 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4d753fd8-d07a-4df7-8b84-496c07281ee6 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:42.604925 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4d753fd8-d07a-4df7-8b84-496c07281ee6 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:42.605351 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4d753fd8-d07a-4df7-8b84-496c07281ee6 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:42.606048 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4d753fd8-d07a-4df7-8b84-496c07281ee6 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:42.606494 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4d753fd8-d07a-4df7-8b84-496c07281ee6 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:42.607565 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4d753fd8-d07a-4df7-8b84-496c07281ee6 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:42.745717 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-4d753fd8-d07a-4df7-8b84-496c07281ee6 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:42.754122 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-4d753fd8-d07a-4df7-8b84-496c07281ee6 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1277 microversion: 2.1 time: 0.160578 Aug 04 22:01:42.762596 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 620/1249] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:42 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:43.781700 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a80dc350-72a8-46d3-9479-000d25429421 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:43.782285 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-a80dc350-72a8-46d3-9479-000d25429421 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:43.788657 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a80dc350-72a8-46d3-9479-000d25429421 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:43.789143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a80dc350-72a8-46d3-9479-000d25429421 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:43.789577 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a80dc350-72a8-46d3-9479-000d25429421 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:43.790318 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a80dc350-72a8-46d3-9479-000d25429421 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:43.790760 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a80dc350-72a8-46d3-9479-000d25429421 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:43.791184 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a80dc350-72a8-46d3-9479-000d25429421 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:43.924255 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-a80dc350-72a8-46d3-9479-000d25429421 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:43.931967 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-a80dc350-72a8-46d3-9479-000d25429421 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1277 microversion: 2.1 time: 0.154551 Aug 04 22:01:43.932569 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 630/1250] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:43 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:44.775258 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-b3f9e202-4284-4a1e-8ea1-3e30a0fb461e req-c145030b-1d26-4af8-9d42-ebcf7aa21439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3804577c-bf12-4560-a7a4-ec0e14e16550", "tag": "fbaef442-2379-4b0d-b9b9-098cd098cb5b"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:01:44.787682 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-b3f9e202-4284-4a1e-8ea1-3e30a0fb461e req-c145030b-1d26-4af8-9d42-ebcf7aa21439 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:44.788544 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-b3f9e202-4284-4a1e-8ea1-3e30a0fb461e req-c145030b-1d26-4af8-9d42-ebcf7aa21439 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:44.788969 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-b3f9e202-4284-4a1e-8ea1-3e30a0fb461e req-c145030b-1d26-4af8-9d42-ebcf7aa21439 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:44.806865 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-b3f9e202-4284-4a1e-8ea1-3e30a0fb461e req-c145030b-1d26-4af8-9d42-ebcf7aa21439 service nova] Creating event network-changed:fbaef442-2379-4b0d-b9b9-098cd098cb5b for instance 3804577c-bf12-4560-a7a4-ec0e14e16550 on hv-cinder-85220 Aug 04 22:01:44.814264 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-b3f9e202-4284-4a1e-8ea1-3e30a0fb461e req-c145030b-1d26-4af8-9d42-ebcf7aa21439 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042533 Aug 04 22:01:44.815078 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 621/1251] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 22:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:01:44.952813 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-1138901e-35f5-4739-9326-f5d0d58d8b85 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:44.953422 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-1138901e-35f5-4739-9326-f5d0d58d8b85 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:44.960444 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1138901e-35f5-4739-9326-f5d0d58d8b85 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:44.960444 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1138901e-35f5-4739-9326-f5d0d58d8b85 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:44.960824 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1138901e-35f5-4739-9326-f5d0d58d8b85 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:44.961522 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1138901e-35f5-4739-9326-f5d0d58d8b85 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:44.961975 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1138901e-35f5-4739-9326-f5d0d58d8b85 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:44.962421 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1138901e-35f5-4739-9326-f5d0d58d8b85 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:45.210833 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1138901e-35f5-4739-9326-f5d0d58d8b85 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:45.220470 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-1138901e-35f5-4739-9326-f5d0d58d8b85 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1277 microversion: 2.1 time: 0.271540 Aug 04 22:01:45.248835 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 631/1252] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:44 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1277 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:46.248884 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-54045cb1-f4d8-4ebd-9135-f5dc561055cd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:46.249569 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-54045cb1-f4d8-4ebd-9135-f5dc561055cd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:46.255670 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-54045cb1-f4d8-4ebd-9135-f5dc561055cd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:46.256147 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-54045cb1-f4d8-4ebd-9135-f5dc561055cd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:46.256575 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-54045cb1-f4d8-4ebd-9135-f5dc561055cd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:46.257254 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-54045cb1-f4d8-4ebd-9135-f5dc561055cd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:46.257693 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-54045cb1-f4d8-4ebd-9135-f5dc561055cd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:46.258137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-54045cb1-f4d8-4ebd-9135-f5dc561055cd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:46.394513 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-54045cb1-f4d8-4ebd-9135-f5dc561055cd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:46.401840 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-54045cb1-f4d8-4ebd-9135-f5dc561055cd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1265 microversion: 2.1 time: 0.158014 Aug 04 22:01:46.402423 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 622/1253] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:46 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:47.424223 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8c1ff996-12f4-4374-b988-138b98da4f62 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:47.424832 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8c1ff996-12f4-4374-b988-138b98da4f62 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:47.431400 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8c1ff996-12f4-4374-b988-138b98da4f62 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:47.431886 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8c1ff996-12f4-4374-b988-138b98da4f62 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:47.432341 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8c1ff996-12f4-4374-b988-138b98da4f62 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:47.433029 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8c1ff996-12f4-4374-b988-138b98da4f62 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:47.433483 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8c1ff996-12f4-4374-b988-138b98da4f62 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:47.433909 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8c1ff996-12f4-4374-b988-138b98da4f62 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:47.571007 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8c1ff996-12f4-4374-b988-138b98da4f62 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:47.574837 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=2 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:01:47.584652 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8c1ff996-12f4-4374-b988-138b98da4f62 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1265 microversion: 2.1 time: 0.165030 Aug 04 22:01:47.585565 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 632/1254] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:47 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:48.617936 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-828aebaf-e962-49ed-b36c-9e00eb702b17 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:48.618567 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-828aebaf-e962-49ed-b36c-9e00eb702b17 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:48.620920 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=2 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:01:48.626082 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-828aebaf-e962-49ed-b36c-9e00eb702b17 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:48.626555 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-828aebaf-e962-49ed-b36c-9e00eb702b17 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:48.626982 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-828aebaf-e962-49ed-b36c-9e00eb702b17 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:48.627655 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-828aebaf-e962-49ed-b36c-9e00eb702b17 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:48.628094 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-828aebaf-e962-49ed-b36c-9e00eb702b17 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:48.628505 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-828aebaf-e962-49ed-b36c-9e00eb702b17 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:48.762800 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-828aebaf-e962-49ed-b36c-9e00eb702b17 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:48.770311 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-828aebaf-e962-49ed-b36c-9e00eb702b17 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1265 microversion: 2.1 time: 0.156113 Aug 04 22:01:48.770872 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 623/1255] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:48 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:49.790653 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-57d9b5b8-522f-47ef-a86e-ee56a5803342 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:49.791269 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-57d9b5b8-522f-47ef-a86e-ee56a5803342 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:49.793474 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=6 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:01:49.798985 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57d9b5b8-522f-47ef-a86e-ee56a5803342 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:49.799468 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57d9b5b8-522f-47ef-a86e-ee56a5803342 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:49.799904 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57d9b5b8-522f-47ef-a86e-ee56a5803342 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:49.800612 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57d9b5b8-522f-47ef-a86e-ee56a5803342 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:49.801063 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57d9b5b8-522f-47ef-a86e-ee56a5803342 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:49.801486 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-57d9b5b8-522f-47ef-a86e-ee56a5803342 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:49.936964 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-57d9b5b8-522f-47ef-a86e-ee56a5803342 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:49.944392 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-57d9b5b8-522f-47ef-a86e-ee56a5803342 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1265 microversion: 2.1 time: 0.157560 Aug 04 22:01:49.944974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 633/1256] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:49 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:50.965609 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-83284f56-aab5-468f-8869-a16624d7112f tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:50.966339 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-83284f56-aab5-468f-8869-a16624d7112f tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:50.972240 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-83284f56-aab5-468f-8869-a16624d7112f tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:50.972718 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-83284f56-aab5-468f-8869-a16624d7112f tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:50.973153 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-83284f56-aab5-468f-8869-a16624d7112f tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:50.973895 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-83284f56-aab5-468f-8869-a16624d7112f tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:50.974380 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-83284f56-aab5-468f-8869-a16624d7112f tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:50.974801 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-83284f56-aab5-468f-8869-a16624d7112f tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:51.111099 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-83284f56-aab5-468f-8869-a16624d7112f tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:51.118473 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-83284f56-aab5-468f-8869-a16624d7112f tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1265 microversion: 2.1 time: 0.156941 Aug 04 22:01:51.119031 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 624/1257] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:50 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:52.139783 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-fe04e6a8-769d-4bdb-a0ca-40d3416817a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:52.140730 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-fe04e6a8-769d-4bdb-a0ca-40d3416817a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:52.147278 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fe04e6a8-769d-4bdb-a0ca-40d3416817a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:52.149068 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fe04e6a8-769d-4bdb-a0ca-40d3416817a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:52.149068 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fe04e6a8-769d-4bdb-a0ca-40d3416817a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:52.149719 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fe04e6a8-769d-4bdb-a0ca-40d3416817a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:52.152041 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fe04e6a8-769d-4bdb-a0ca-40d3416817a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:52.152041 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-fe04e6a8-769d-4bdb-a0ca-40d3416817a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:52.331308 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-fe04e6a8-769d-4bdb-a0ca-40d3416817a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:52.338976 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-fe04e6a8-769d-4bdb-a0ca-40d3416817a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1265 microversion: 2.1 time: 0.203257 Aug 04 22:01:52.339549 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 634/1258] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:52 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:53.360731 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-34351ce6-b717-4c1d-a29f-087f0b2e1134 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:53.361317 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-34351ce6-b717-4c1d-a29f-087f0b2e1134 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:53.367756 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-34351ce6-b717-4c1d-a29f-087f0b2e1134 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:53.368231 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-34351ce6-b717-4c1d-a29f-087f0b2e1134 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:53.368666 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-34351ce6-b717-4c1d-a29f-087f0b2e1134 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:53.369349 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-34351ce6-b717-4c1d-a29f-087f0b2e1134 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:53.369801 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-34351ce6-b717-4c1d-a29f-087f0b2e1134 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:53.370249 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-34351ce6-b717-4c1d-a29f-087f0b2e1134 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:53.502121 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-34351ce6-b717-4c1d-a29f-087f0b2e1134 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:53.509614 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-34351ce6-b717-4c1d-a29f-087f0b2e1134 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1265 microversion: 2.1 time: 0.152738 Aug 04 22:01:53.510199 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 625/1259] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:53 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:54.531062 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b28e3d1d-56c5-4008-8c47-2a3edc57155e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:54.531688 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b28e3d1d-56c5-4008-8c47-2a3edc57155e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:54.538342 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b28e3d1d-56c5-4008-8c47-2a3edc57155e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:54.538826 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b28e3d1d-56c5-4008-8c47-2a3edc57155e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:54.539251 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b28e3d1d-56c5-4008-8c47-2a3edc57155e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:54.539947 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b28e3d1d-56c5-4008-8c47-2a3edc57155e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:54.540392 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b28e3d1d-56c5-4008-8c47-2a3edc57155e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:54.540807 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b28e3d1d-56c5-4008-8c47-2a3edc57155e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:54.672720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b28e3d1d-56c5-4008-8c47-2a3edc57155e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:54.680160 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b28e3d1d-56c5-4008-8c47-2a3edc57155e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1265 microversion: 2.1 time: 0.153877 Aug 04 22:01:54.680719 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 635/1260] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:54 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:55.701804 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b4bdf325-c1b3-4e7e-a251-1b4749c45bcd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:55.702475 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b4bdf325-c1b3-4e7e-a251-1b4749c45bcd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:55.708842 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b4bdf325-c1b3-4e7e-a251-1b4749c45bcd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:55.709323 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b4bdf325-c1b3-4e7e-a251-1b4749c45bcd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:55.709754 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b4bdf325-c1b3-4e7e-a251-1b4749c45bcd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:55.710476 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b4bdf325-c1b3-4e7e-a251-1b4749c45bcd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:55.710924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b4bdf325-c1b3-4e7e-a251-1b4749c45bcd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:55.711346 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b4bdf325-c1b3-4e7e-a251-1b4749c45bcd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:55.847336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b4bdf325-c1b3-4e7e-a251-1b4749c45bcd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:55.857914 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b4bdf325-c1b3-4e7e-a251-1b4749c45bcd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1265 microversion: 2.1 time: 0.160355 Aug 04 22:01:55.858565 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 626/1261] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:55 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:56.884190 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-3bf7ceae-9774-403e-8e58-d90ceea03513 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:56.884815 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-3bf7ceae-9774-403e-8e58-d90ceea03513 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:56.891418 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bf7ceae-9774-403e-8e58-d90ceea03513 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:56.891897 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bf7ceae-9774-403e-8e58-d90ceea03513 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:56.892320 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bf7ceae-9774-403e-8e58-d90ceea03513 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:56.893006 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bf7ceae-9774-403e-8e58-d90ceea03513 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:56.893450 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bf7ceae-9774-403e-8e58-d90ceea03513 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:56.893867 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-3bf7ceae-9774-403e-8e58-d90ceea03513 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:57.032343 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-3bf7ceae-9774-403e-8e58-d90ceea03513 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:57.039710 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-3bf7ceae-9774-403e-8e58-d90ceea03513 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1265 microversion: 2.1 time: 0.159432 Aug 04 22:01:57.042153 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 636/1262] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:56 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:58.061637 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a950c98c-8076-449c-8d45-49f75d8d27dd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:58.062275 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a950c98c-8076-449c-8d45-49f75d8d27dd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:58.068731 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a950c98c-8076-449c-8d45-49f75d8d27dd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:58.069190 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a950c98c-8076-449c-8d45-49f75d8d27dd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:58.069619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a950c98c-8076-449c-8d45-49f75d8d27dd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:58.070345 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a950c98c-8076-449c-8d45-49f75d8d27dd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:58.070794 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a950c98c-8076-449c-8d45-49f75d8d27dd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:58.071207 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a950c98c-8076-449c-8d45-49f75d8d27dd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:58.213169 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a950c98c-8076-449c-8d45-49f75d8d27dd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:58.220767 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a950c98c-8076-449c-8d45-49f75d8d27dd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1265 microversion: 2.1 time: 0.163636 Aug 04 22:01:58.221335 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 627/1263] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:58 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:01:59.243285 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-1f913ee4-2807-48a5-b8be-0d2234d89274 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:01:59.243929 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-1f913ee4-2807-48a5-b8be-0d2234d89274 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:01:59.251473 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1f913ee4-2807-48a5-b8be-0d2234d89274 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:59.251955 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1f913ee4-2807-48a5-b8be-0d2234d89274 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:59.252385 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1f913ee4-2807-48a5-b8be-0d2234d89274 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:59.253125 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1f913ee4-2807-48a5-b8be-0d2234d89274 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:01:59.253572 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1f913ee4-2807-48a5-b8be-0d2234d89274 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:01:59.253987 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1f913ee4-2807-48a5-b8be-0d2234d89274 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:01:59.393296 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1f913ee4-2807-48a5-b8be-0d2234d89274 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:01:59.403628 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-1f913ee4-2807-48a5-b8be-0d2234d89274 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1265 microversion: 2.1 time: 0.163784 Aug 04 22:01:59.404206 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 637/1264] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:01:59 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:02:00.367617 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-c98c2cea-81cc-4ddb-9696-26df97516be9 req-b8e31c95-0af2-42e3-805e-a7ef89faf7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3804577c-bf12-4560-a7a4-ec0e14e16550", "name": "network-vif-plugged", "status": "completed", "tag": "fbaef442-2379-4b0d-b9b9-098cd098cb5b"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:02:00.378321 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-c98c2cea-81cc-4ddb-9696-26df97516be9 req-b8e31c95-0af2-42e3-805e-a7ef89faf7a2 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:00.378796 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-c98c2cea-81cc-4ddb-9696-26df97516be9 req-b8e31c95-0af2-42e3-805e-a7ef89faf7a2 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:00.379216 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-c98c2cea-81cc-4ddb-9696-26df97516be9 req-b8e31c95-0af2-42e3-805e-a7ef89faf7a2 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:00.391111 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-c98c2cea-81cc-4ddb-9696-26df97516be9 req-b8e31c95-0af2-42e3-805e-a7ef89faf7a2 service nova] Creating event network-vif-plugged:fbaef442-2379-4b0d-b9b9-098cd098cb5b for instance 3804577c-bf12-4560-a7a4-ec0e14e16550 on hv-cinder-85220 Aug 04 22:02:00.396217 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-c98c2cea-81cc-4ddb-9696-26df97516be9 req-b8e31c95-0af2-42e3-805e-a7ef89faf7a2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032315 Aug 04 22:02:00.396857 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 628/1265] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 22:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:02:00.425737 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-83ed8851-7231-4a82-925e-20a1e2cd3825 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:00.429849 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-83ed8851-7231-4a82-925e-20a1e2cd3825 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:00.429849 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:02:00.433563 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-83ed8851-7231-4a82-925e-20a1e2cd3825 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:00.434086 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-83ed8851-7231-4a82-925e-20a1e2cd3825 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:00.434521 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-83ed8851-7231-4a82-925e-20a1e2cd3825 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:00.435294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-83ed8851-7231-4a82-925e-20a1e2cd3825 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:00.435703 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-83ed8851-7231-4a82-925e-20a1e2cd3825 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:00.436125 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-83ed8851-7231-4a82-925e-20a1e2cd3825 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:00.438796 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:02:00.597277 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-83ed8851-7231-4a82-925e-20a1e2cd3825 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:02:00.605844 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-83ed8851-7231-4a82-925e-20a1e2cd3825 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1265 microversion: 2.1 time: 0.183847 Aug 04 22:02:00.606773 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 638/1266] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:00 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:02:00.942086 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b0bd3ed7-6c90-448e-bd52-ecf89dc39111 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:00.942677 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b0bd3ed7-6c90-448e-bd52-ecf89dc39111 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:00.949310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b0bd3ed7-6c90-448e-bd52-ecf89dc39111 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:00.949825 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b0bd3ed7-6c90-448e-bd52-ecf89dc39111 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:00.950451 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b0bd3ed7-6c90-448e-bd52-ecf89dc39111 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:00.951902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b0bd3ed7-6c90-448e-bd52-ecf89dc39111 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:00.952382 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b0bd3ed7-6c90-448e-bd52-ecf89dc39111 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:00.952824 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b0bd3ed7-6c90-448e-bd52-ecf89dc39111 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:01.038665 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.objects.instance [None req-b0bd3ed7-6c90-448e-bd52-ecf89dc39111 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lazy-loading 'services' on Instance uuid daa39858-9346-44f0-860c-715283f9fa55 {{(pid=136341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:02:01.245357 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b0bd3ed7-6c90-448e-bd52-ecf89dc39111 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "DELETE /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55/os-volume_attachments/f18f0411-cb56-491b-9de8-2ecba7583f0a" status: 202 len: 0 microversion: 2.1 time: 0.307555 Aug 04 22:02:01.245953 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 629/1267] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 4 22:02:00 2022] DELETE /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55/os-volume_attachments/f18f0411-cb56-491b-9de8-2ecba7583f0a => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:02:01.628250 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-4252bfdf-ff25-460a-a66e-01ac529f8d60 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:01.628838 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-4252bfdf-ff25-460a-a66e-01ac529f8d60 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:01.636336 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4252bfdf-ff25-460a-a66e-01ac529f8d60 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:01.636817 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4252bfdf-ff25-460a-a66e-01ac529f8d60 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:01.637246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4252bfdf-ff25-460a-a66e-01ac529f8d60 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:01.638491 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4252bfdf-ff25-460a-a66e-01ac529f8d60 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:01.638950 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4252bfdf-ff25-460a-a66e-01ac529f8d60 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:01.639368 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-4252bfdf-ff25-460a-a66e-01ac529f8d60 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:01.776030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-4252bfdf-ff25-460a-a66e-01ac529f8d60 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:02:01.783973 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-4252bfdf-ff25-460a-a66e-01ac529f8d60 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1265 microversion: 2.1 time: 0.159876 Aug 04 22:02:01.784540 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 639/1268] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:01 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:02:02.806303 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a0532000-f593-4b9b-9f22-1415da6022a0 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:02.807152 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a0532000-f593-4b9b-9f22-1415da6022a0 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:02.808890 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:02:02.815006 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0532000-f593-4b9b-9f22-1415da6022a0 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:02.815483 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0532000-f593-4b9b-9f22-1415da6022a0 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:02.815930 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0532000-f593-4b9b-9f22-1415da6022a0 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:02.816805 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0532000-f593-4b9b-9f22-1415da6022a0 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:02.817898 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0532000-f593-4b9b-9f22-1415da6022a0 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:02.818363 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a0532000-f593-4b9b-9f22-1415da6022a0 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:02.825066 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:02:02.972468 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a0532000-f593-4b9b-9f22-1415da6022a0 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:02:02.980658 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a0532000-f593-4b9b-9f22-1415da6022a0 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1452 microversion: 2.1 time: 0.179249 Aug 04 22:02:02.981421 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 630/1269] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:02 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1452 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:02:03.002778 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-43f20b35-69c1-4399-8a33-b81eb0b6a5b4 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:03.003482 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-43f20b35-69c1-4399-8a33-b81eb0b6a5b4 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:03.010297 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-43f20b35-69c1-4399-8a33-b81eb0b6a5b4 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:03.010786 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-43f20b35-69c1-4399-8a33-b81eb0b6a5b4 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:03.011220 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-43f20b35-69c1-4399-8a33-b81eb0b6a5b4 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:03.011934 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-43f20b35-69c1-4399-8a33-b81eb0b6a5b4 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:03.012382 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-43f20b35-69c1-4399-8a33-b81eb0b6a5b4 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:03.013322 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-43f20b35-69c1-4399-8a33-b81eb0b6a5b4 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:03.159654 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-43f20b35-69c1-4399-8a33-b81eb0b6a5b4 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:02:03.167405 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-43f20b35-69c1-4399-8a33-b81eb0b6a5b4 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1452 microversion: 2.1 time: 0.169574 Aug 04 22:02:03.167993 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 640/1270] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:02 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:02:04.502951 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-106b680e-0130-4ca6-940b-a658877601ca tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:04.503498 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-106b680e-0130-4ca6-940b-a658877601ca tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:04.509918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-106b680e-0130-4ca6-940b-a658877601ca tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:04.510446 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-106b680e-0130-4ca6-940b-a658877601ca tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:04.510884 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-106b680e-0130-4ca6-940b-a658877601ca tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:04.511612 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-106b680e-0130-4ca6-940b-a658877601ca tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:04.512062 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-106b680e-0130-4ca6-940b-a658877601ca tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:04.512488 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-106b680e-0130-4ca6-940b-a658877601ca tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:04.539423 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-106b680e-0130-4ca6-940b-a658877601ca tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] Going to try to terminate instance {{(pid=136341) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:02:04.817802 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-106b680e-0130-4ca6-940b-a658877601ca tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "DELETE /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55" status: 204 len: 0 microversion: 2.1 time: 0.318344 Aug 04 22:02:04.818675 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 631/1271] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 22:02:04 2022] DELETE /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:02:04.828628 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-bdafe63a-ee6a-4c22-b768-57cc0fa8fff9 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:04.829248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-bdafe63a-ee6a-4c22-b768-57cc0fa8fff9 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:04.836095 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bdafe63a-ee6a-4c22-b768-57cc0fa8fff9 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:04.836582 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bdafe63a-ee6a-4c22-b768-57cc0fa8fff9 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:04.837008 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bdafe63a-ee6a-4c22-b768-57cc0fa8fff9 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:04.837801 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bdafe63a-ee6a-4c22-b768-57cc0fa8fff9 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:04.838342 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bdafe63a-ee6a-4c22-b768-57cc0fa8fff9 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:04.838764 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-bdafe63a-ee6a-4c22-b768-57cc0fa8fff9 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:05.075359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-bdafe63a-ee6a-4c22-b768-57cc0fa8fff9 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:02:05.083241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-bdafe63a-ee6a-4c22-b768-57cc0fa8fff9 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55" status: 200 len: 1514 microversion: 2.1 time: 0.260124 Aug 04 22:02:05.083927 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 641/1272] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:04 2022] GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55 => generated 1514 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:02:05.452972 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-cfe4cdf2-44a6-4c4d-9e52-5cddd5fd71d6 req-2c454f98-26ae-4f3d-93c5-cee4bcad4916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3804577c-bf12-4560-a7a4-ec0e14e16550", "tag": "fbaef442-2379-4b0d-b9b9-098cd098cb5b"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:02:05.462674 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-cfe4cdf2-44a6-4c4d-9e52-5cddd5fd71d6 req-2c454f98-26ae-4f3d-93c5-cee4bcad4916 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:05.463148 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-cfe4cdf2-44a6-4c4d-9e52-5cddd5fd71d6 req-2c454f98-26ae-4f3d-93c5-cee4bcad4916 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:05.463574 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-cfe4cdf2-44a6-4c4d-9e52-5cddd5fd71d6 req-2c454f98-26ae-4f3d-93c5-cee4bcad4916 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:05.475952 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-cfe4cdf2-44a6-4c4d-9e52-5cddd5fd71d6 req-2c454f98-26ae-4f3d-93c5-cee4bcad4916 service nova] Creating event network-changed:fbaef442-2379-4b0d-b9b9-098cd098cb5b for instance 3804577c-bf12-4560-a7a4-ec0e14e16550 on hv-cinder-85220 Aug 04 22:02:05.480896 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-cfe4cdf2-44a6-4c4d-9e52-5cddd5fd71d6 req-2c454f98-26ae-4f3d-93c5-cee4bcad4916 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033459 Aug 04 22:02:05.482123 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 632/1273] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 22:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:02:06.104550 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-70fb2115-0d7c-4afe-937b-6863f6d4336f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:06.105361 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-70fb2115-0d7c-4afe-937b-6863f6d4336f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:06.112865 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-70fb2115-0d7c-4afe-937b-6863f6d4336f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:06.113346 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-70fb2115-0d7c-4afe-937b-6863f6d4336f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:06.113773 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-70fb2115-0d7c-4afe-937b-6863f6d4336f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:06.114501 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-70fb2115-0d7c-4afe-937b-6863f6d4336f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:06.114950 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-70fb2115-0d7c-4afe-937b-6863f6d4336f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:06.115362 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-70fb2115-0d7c-4afe-937b-6863f6d4336f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:06.259754 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-70fb2115-0d7c-4afe-937b-6863f6d4336f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:02:06.269009 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-70fb2115-0d7c-4afe-937b-6863f6d4336f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55" status: 200 len: 1514 microversion: 2.1 time: 0.168299 Aug 04 22:02:06.269584 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 642/1274] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:06 2022] GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:02:07.290741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-568dd462-d792-410e-9bf0-68f59db112ba tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:07.291444 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-568dd462-d792-410e-9bf0-68f59db112ba tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:07.298909 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-568dd462-d792-410e-9bf0-68f59db112ba tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:07.299406 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-568dd462-d792-410e-9bf0-68f59db112ba tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:07.299832 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-568dd462-d792-410e-9bf0-68f59db112ba tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:07.300728 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-568dd462-d792-410e-9bf0-68f59db112ba tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:07.301354 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-568dd462-d792-410e-9bf0-68f59db112ba tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:07.301790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-568dd462-d792-410e-9bf0-68f59db112ba tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:07.512232 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-568dd462-d792-410e-9bf0-68f59db112ba tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:02:07.520518 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-568dd462-d792-410e-9bf0-68f59db112ba tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55" status: 200 len: 1514 microversion: 2.1 time: 0.233845 Aug 04 22:02:07.521360 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 633/1275] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:07 2022] GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55 => generated 1514 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:02:07.534854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:02:07.535368 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Thu Aug 4 22:02:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:02:07.808634 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-b4116a10-95a7-4acd-8016-b42e48bbaafe req-b842d1f9-bd7c-4c4d-af34-93487e006e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa39858-9346-44f0-860c-715283f9fa55", "name": "network-vif-deleted", "tag": "35202b9a-bcc6-4539-801a-53f490082518"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:02:07.818597 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-b4116a10-95a7-4acd-8016-b42e48bbaafe req-b842d1f9-bd7c-4c4d-af34-93487e006e75 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:07.823577 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-b4116a10-95a7-4acd-8016-b42e48bbaafe req-b842d1f9-bd7c-4c4d-af34-93487e006e75 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:07.823577 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-b4116a10-95a7-4acd-8016-b42e48bbaafe req-b842d1f9-bd7c-4c4d-af34-93487e006e75 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:07.831882 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-b4116a10-95a7-4acd-8016-b42e48bbaafe req-b842d1f9-bd7c-4c4d-af34-93487e006e75 service nova] Creating event network-vif-deleted:35202b9a-bcc6-4539-801a-53f490082518 for instance daa39858-9346-44f0-860c-715283f9fa55 on hv-cinder-85220 Aug 04 22:02:07.837061 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-b4116a10-95a7-4acd-8016-b42e48bbaafe req-b842d1f9-bd7c-4c4d-af34-93487e006e75 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097728 Aug 04 22:02:07.837658 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 643/1276] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 22:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:02:08.544502 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-3a259980-ea77-4fb5-abaa-bf4787b32a24 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:08.545372 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-3a259980-ea77-4fb5-abaa-bf4787b32a24 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:08.552072 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3a259980-ea77-4fb5-abaa-bf4787b32a24 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:08.552589 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3a259980-ea77-4fb5-abaa-bf4787b32a24 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:08.553027 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3a259980-ea77-4fb5-abaa-bf4787b32a24 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:08.553718 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3a259980-ea77-4fb5-abaa-bf4787b32a24 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:08.554210 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3a259980-ea77-4fb5-abaa-bf4787b32a24 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:08.554633 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3a259980-ea77-4fb5-abaa-bf4787b32a24 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:08.585957 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3a259980-ea77-4fb5-abaa-bf4787b32a24 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:08.586411 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3a259980-ea77-4fb5-abaa-bf4787b32a24 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:08.586848 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-3a259980-ea77-4fb5-abaa-bf4787b32a24 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:08.587321 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.objects.instance [None req-3a259980-ea77-4fb5-abaa-bf4787b32a24 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lazy-loading 'fault' on Instance uuid daa39858-9346-44f0-860c-715283f9fa55 {{(pid=136341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:02:08.629453 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-3a259980-ea77-4fb5-abaa-bf4787b32a24 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:02:08.637290 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-3a259980-ea77-4fb5-abaa-bf4787b32a24 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55" status: 200 len: 1309 microversion: 2.1 time: 0.097111 Aug 04 22:02:08.637691 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 634/1277] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:08 2022] GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:02:09.659329 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-9141c970-41e2-40c1-bcfb-d291e4601d2f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:09.660030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-9141c970-41e2-40c1-bcfb-d291e4601d2f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: daa39858-9346-44f0-860c-715283f9fa55] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:09.666282 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9141c970-41e2-40c1-bcfb-d291e4601d2f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:09.669257 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9141c970-41e2-40c1-bcfb-d291e4601d2f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:09.669257 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9141c970-41e2-40c1-bcfb-d291e4601d2f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:09.669257 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9141c970-41e2-40c1-bcfb-d291e4601d2f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:09.669257 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9141c970-41e2-40c1-bcfb-d291e4601d2f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:09.669735 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9141c970-41e2-40c1-bcfb-d291e4601d2f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:09.683028 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-9141c970-41e2-40c1-bcfb-d291e4601d2f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] HTTP exception thrown: Instance daa39858-9346-44f0-860c-715283f9fa55 could not be found. Aug 04 22:02:09.686048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-9141c970-41e2-40c1-bcfb-d291e4601d2f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Request method failure captured: Aug 04 22:02:09.686048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55 HTTP/1.1 Aug 04 22:02:09.686048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 22:02:09.686048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 22:02:09.686048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 22:02:09.686048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 22:02:09.686048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 22:02:09.686048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 22:02:09.686048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 22:02:09.686048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 22:02:09.686048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7EGUkfS7fjw7QbjdTMES1uIMOa1Frh9zsc7bLWBulni6wEs3V7dFPDSjS4b_TnAEhog5h1_VvGA-tLykkPYINPAdjepNk0MOqErO_Aep8y6O0ffcUrqupn-ovyIPJnNNOzMy9mqy3zgCN8C_C9UM5a8WdepyjmVBO91T2S6bqJ24LZ8 Aug 04 22:02:09.686048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 22:02:09.686048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 22:02:09.686048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 22:02:09.686048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 22:02:09.686048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 22:02:09.686048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 22:02:09.686048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: 0e75154a4e9e4562b0757fc22af26d1e Aug 04 22:02:09.686048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-VolumesSnapshotTestJSON-594106867 Aug 04 22:02:09.686048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 22:02:09.686048 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 22:02:09.687740 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0e75154a4e9e4562b0757fc22af26d1e", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0e75154a4e9e4562b0757fc22af26d1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0e75154a4e9e4562b0757fc22af26d1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0e75154a4e9e4562b0757fc22af26d1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 22:02:09.687740 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-VolumesSnapshotTestJSON-594106867 Aug 04 22:02:09.687740 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: 0e75154a4e9e4562b0757fc22af26d1e Aug 04 22:02:09.687740 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-594106867 Aug 04 22:02:09.687740 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-VolumesSnapshotTestJSON-594106867-project Aug 04 22:02:09.687740 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 22:02:09.687740 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 22:02:09.687740 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: 037873250f324a82ba88d4ee151bfa2e Aug 04 22:02:09.687740 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-VolumesSnapshotTestJSON-594106867-project Aug 04 22:02:09.687740 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 22:02:09.687740 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance daa39858-9346-44f0-860c-715283f9fa55 could not be found. Aug 04 22:02:09.687740 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': 'daa39858-9346-44f0-860c-715283f9fa55'} Aug 04 22:02:09.688685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:02:09.688685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:02:09.688685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:02:09.688685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:02:09.688685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:02:09.688685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:02:09.688685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:02:09.688685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:02:09.688685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:02:09.688685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:02:09.688685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daa39858-9346-44f0-860c-715283f9fa55 could not be found. Aug 04 22:02:09.688685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 22:02:09.688685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:02:09.688685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 22:02:09.688685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:02:09.688685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:02:09.688685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:02:09.688685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:02:09.688685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:02:09.688685 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:02:09.690246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:02:09.690246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:02:09.690246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:02:09.690246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:02:09.690246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:02:09.690246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:02:09.690246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:02:09.690246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa39858-9346-44f0-860c-715283f9fa55 could not be found. Aug 04 22:02:09.690246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 22:02:09.690246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:02:09.690246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 22:02:09.690246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:02:09.690246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:02:09.690246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:02:09.690246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:02:09.690246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:02:09.690246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa39858-9346-44f0-860c-715283f9fa55 could not be found. Aug 04 22:02:09.690246 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 22:02:09.691872 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-9141c970-41e2-40c1-bcfb-d291e4601d2f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Returning 404 to user: Instance daa39858-9346-44f0-860c-715283f9fa55 could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:02:09.691872 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-9141c970-41e2-40c1-bcfb-d291e4601d2f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55" status: 404 len: 111 microversion: 2.1 time: 0.032933 Aug 04 22:02:09.691872 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 644/1278] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:09 2022] GET /compute/v2.1/servers/daa39858-9346-44f0-860c-715283f9fa55 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:02:20.255065 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-8ab84032-126b-4b95-a324-c3765f75e518 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-783923279", "imageRef": "fca0c9ba-fb0a-4f30-932f-84d5253674ad", "flavorRef": "452", "networks": [{"uuid": "3edb4f2d-080b-426f-9239-6ed63cc0b663"}]}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:02:20.264310 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:02:20.264968 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:02:20.310757 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.network.neutron [None req-8ab84032-126b-4b95-a324-c3765f75e518 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] validate_networks() for [('3edb4f2d-080b-426f-9239-6ed63cc0b663', None, None, None, None, None)] {{(pid=136341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:02:20.681904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-8ab84032-126b-4b95-a324-c3765f75e518 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Flavor limits 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:02:20.682364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-8ab84032-126b-4b95-a324-c3765f75e518 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Image limits 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:02:20.682830 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-8ab84032-126b-4b95-a324-c3765f75e518 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Flavor pref 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:02:20.683234 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-8ab84032-126b-4b95-a324-c3765f75e518 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Image pref 0:0:0 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:02:20.683646 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.virt.hardware [None req-8ab84032-126b-4b95-a324-c3765f75e518 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:02:20.692862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8ab84032-126b-4b95-a324-c3765f75e518 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:20.693270 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8ab84032-126b-4b95-a324-c3765f75e518 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:20.693703 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8ab84032-126b-4b95-a324-c3765f75e518 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:20.694469 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8ab84032-126b-4b95-a324-c3765f75e518 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:20.694918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8ab84032-126b-4b95-a324-c3765f75e518 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:20.695336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-8ab84032-126b-4b95-a324-c3765f75e518 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:20.713086 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-8ab84032-126b-4b95-a324-c3765f75e518 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Getting quotas for project 0e75154a4e9e4562b0757fc22af26d1e. Resources: {'instances', 'cores', 'ram'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:02:20.717738 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.quota [None req-8ab84032-126b-4b95-a324-c3765f75e518 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Getting quotas for user 037873250f324a82ba88d4ee151bfa2e and project 0e75154a4e9e4562b0757fc22af26d1e. Resources: {'instances', 'cores', 'ram'} {{(pid=136341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:02:20.728724 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-8ab84032-126b-4b95-a324-c3765f75e518 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Going to run 1 instances... {{(pid=136341) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:02:20.730985 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-8ab84032-126b-4b95-a324-c3765f75e518 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca0c9ba-fb0a-4f30-932f-84d5253674ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:02:20.856881 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-8ab84032-126b-4b95-a324-c3765f75e518 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605607 Aug 04 22:02:20.857519 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 635/1279] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 4 22:02:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 22:02:20.868190 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-cc1a873f-485b-4c4f-91d3-b47170f77b6e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:20.868809 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-cc1a873f-485b-4c4f-91d3-b47170f77b6e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:20.871136 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=13 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:02:20.871822 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=33 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:02:20.930811 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-cc1a873f-485b-4c4f-91d3-b47170f77b6e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:02:20.939390 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-cc1a873f-485b-4c4f-91d3-b47170f77b6e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0" status: 200 len: 1218 microversion: 2.1 time: 0.075011 Aug 04 22:02:20.939953 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 645/1280] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:20 2022] GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:02:21.960470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-99f9f20e-5e1b-44af-b38b-3a9cf74461d6 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:21.962000 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-99f9f20e-5e1b-44af-b38b-3a9cf74461d6 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:21.970678 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-99f9f20e-5e1b-44af-b38b-3a9cf74461d6 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:21.971152 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-99f9f20e-5e1b-44af-b38b-3a9cf74461d6 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:21.971688 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-99f9f20e-5e1b-44af-b38b-3a9cf74461d6 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:21.972525 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-99f9f20e-5e1b-44af-b38b-3a9cf74461d6 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:21.972971 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-99f9f20e-5e1b-44af-b38b-3a9cf74461d6 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:21.973388 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-99f9f20e-5e1b-44af-b38b-3a9cf74461d6 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:22.035890 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-99f9f20e-5e1b-44af-b38b-3a9cf74461d6 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:02:22.043373 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-99f9f20e-5e1b-44af-b38b-3a9cf74461d6 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0" status: 200 len: 1214 microversion: 2.1 time: 0.087260 Aug 04 22:02:22.043947 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 636/1281] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:21 2022] GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:02:23.067143 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-7f4321a4-470b-4d5a-87b0-5796b480952f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:23.067765 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7f4321a4-470b-4d5a-87b0-5796b480952f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:23.076106 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7f4321a4-470b-4d5a-87b0-5796b480952f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:23.076600 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7f4321a4-470b-4d5a-87b0-5796b480952f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:23.077037 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7f4321a4-470b-4d5a-87b0-5796b480952f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:23.077764 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7f4321a4-470b-4d5a-87b0-5796b480952f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:23.078255 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7f4321a4-470b-4d5a-87b0-5796b480952f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:23.078681 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7f4321a4-470b-4d5a-87b0-5796b480952f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:23.141881 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-7f4321a4-470b-4d5a-87b0-5796b480952f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:02:23.149688 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-7f4321a4-470b-4d5a-87b0-5796b480952f tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0" status: 200 len: 1276 microversion: 2.1 time: 0.086488 Aug 04 22:02:23.150360 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 646/1282] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:23 2022] GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0 => generated 1276 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:02:24.171412 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-6ffc2595-7214-49d6-94c0-d7b792f85fba tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:24.172005 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-6ffc2595-7214-49d6-94c0-d7b792f85fba tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:24.178417 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6ffc2595-7214-49d6-94c0-d7b792f85fba tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:24.178904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6ffc2595-7214-49d6-94c0-d7b792f85fba tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:24.179336 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6ffc2595-7214-49d6-94c0-d7b792f85fba tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:24.180034 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6ffc2595-7214-49d6-94c0-d7b792f85fba tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:24.180633 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6ffc2595-7214-49d6-94c0-d7b792f85fba tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:24.181055 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6ffc2595-7214-49d6-94c0-d7b792f85fba tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:24.338349 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-9e1e1257-5a8f-4f3e-a90d-786c47bf12b4 req-206d2a0e-e56f-4988-96b3-ed5201165cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0bef917-546a-4727-ac72-4496707a8de0", "tag": "84b461a7-d819-4cd6-adaf-e0af3361d0fd"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:02:24.347691 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-6ffc2595-7214-49d6-94c0-d7b792f85fba tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:02:24.351088 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-9e1e1257-5a8f-4f3e-a90d-786c47bf12b4 req-206d2a0e-e56f-4988-96b3-ed5201165cc2 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:24.351789 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-9e1e1257-5a8f-4f3e-a90d-786c47bf12b4 req-206d2a0e-e56f-4988-96b3-ed5201165cc2 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:24.352633 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-9e1e1257-5a8f-4f3e-a90d-786c47bf12b4 req-206d2a0e-e56f-4988-96b3-ed5201165cc2 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:24.361054 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-6ffc2595-7214-49d6-94c0-d7b792f85fba tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0" status: 200 len: 1318 microversion: 2.1 time: 0.193531 Aug 04 22:02:24.361859 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 637/1283] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:24 2022] GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:02:24.366454 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-9e1e1257-5a8f-4f3e-a90d-786c47bf12b4 req-206d2a0e-e56f-4988-96b3-ed5201165cc2 service nova] Creating event network-changed:84b461a7-d819-4cd6-adaf-e0af3361d0fd for instance b0bef917-546a-4727-ac72-4496707a8de0 on hv-cinder-85220 Aug 04 22:02:24.372974 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-9e1e1257-5a8f-4f3e-a90d-786c47bf12b4 req-206d2a0e-e56f-4988-96b3-ed5201165cc2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037735 Aug 04 22:02:24.373669 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 647/1284] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 22:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:02:25.383329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-43252a07-bf4f-4c40-afb3-5e91469bd6fc tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:25.383951 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-43252a07-bf4f-4c40-afb3-5e91469bd6fc tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:25.391114 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-43252a07-bf4f-4c40-afb3-5e91469bd6fc tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:25.391591 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-43252a07-bf4f-4c40-afb3-5e91469bd6fc tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:25.392020 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-43252a07-bf4f-4c40-afb3-5e91469bd6fc tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:25.392705 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-43252a07-bf4f-4c40-afb3-5e91469bd6fc tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:25.393149 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-43252a07-bf4f-4c40-afb3-5e91469bd6fc tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:25.393562 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-43252a07-bf4f-4c40-afb3-5e91469bd6fc tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:25.529789 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-43252a07-bf4f-4c40-afb3-5e91469bd6fc tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:02:25.537341 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-43252a07-bf4f-4c40-afb3-5e91469bd6fc tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0" status: 200 len: 1318 microversion: 2.1 time: 0.157862 Aug 04 22:02:25.537917 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 638/1285] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:25 2022] GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:02:26.562250 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f4cee03d-2a24-43ae-9b3f-a83692deb2c5 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:26.563064 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-f4cee03d-2a24-43ae-9b3f-a83692deb2c5 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:26.573170 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f4cee03d-2a24-43ae-9b3f-a83692deb2c5 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:26.573849 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f4cee03d-2a24-43ae-9b3f-a83692deb2c5 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:26.574515 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f4cee03d-2a24-43ae-9b3f-a83692deb2c5 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:26.576500 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f4cee03d-2a24-43ae-9b3f-a83692deb2c5 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:26.577339 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f4cee03d-2a24-43ae-9b3f-a83692deb2c5 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:26.578720 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f4cee03d-2a24-43ae-9b3f-a83692deb2c5 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:26.717841 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-f4cee03d-2a24-43ae-9b3f-a83692deb2c5 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:02:26.725224 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-f4cee03d-2a24-43ae-9b3f-a83692deb2c5 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0" status: 200 len: 1318 microversion: 2.1 time: 0.169718 Aug 04 22:02:26.725782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 648/1286] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:26 2022] GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:02:27.745745 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ed5aec28-7ef9-4d23-950f-2be6592ef2e1 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:27.746524 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ed5aec28-7ef9-4d23-950f-2be6592ef2e1 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:27.753926 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ed5aec28-7ef9-4d23-950f-2be6592ef2e1 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:27.754440 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ed5aec28-7ef9-4d23-950f-2be6592ef2e1 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:27.754869 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ed5aec28-7ef9-4d23-950f-2be6592ef2e1 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:27.755551 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ed5aec28-7ef9-4d23-950f-2be6592ef2e1 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:27.755994 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ed5aec28-7ef9-4d23-950f-2be6592ef2e1 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:27.756408 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ed5aec28-7ef9-4d23-950f-2be6592ef2e1 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:27.893115 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ed5aec28-7ef9-4d23-950f-2be6592ef2e1 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:02:27.900554 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ed5aec28-7ef9-4d23-950f-2be6592ef2e1 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0" status: 200 len: 1318 microversion: 2.1 time: 0.158777 Aug 04 22:02:27.901110 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 639/1287] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:27 2022] GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:02:28.922068 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-9b4b9b56-313e-4e5e-94e6-bc090e618c0d tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:28.922645 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-9b4b9b56-313e-4e5e-94e6-bc090e618c0d tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:28.929128 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9b4b9b56-313e-4e5e-94e6-bc090e618c0d tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:28.929638 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9b4b9b56-313e-4e5e-94e6-bc090e618c0d tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:28.930098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9b4b9b56-313e-4e5e-94e6-bc090e618c0d tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:28.930800 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9b4b9b56-313e-4e5e-94e6-bc090e618c0d tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:28.931252 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9b4b9b56-313e-4e5e-94e6-bc090e618c0d tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:28.931673 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-9b4b9b56-313e-4e5e-94e6-bc090e618c0d tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:29.064169 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-9b4b9b56-313e-4e5e-94e6-bc090e618c0d tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:02:29.071669 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-9b4b9b56-313e-4e5e-94e6-bc090e618c0d tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0" status: 200 len: 1318 microversion: 2.1 time: 0.154373 Aug 04 22:02:29.072236 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 649/1288] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:28 2022] GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:02:30.093195 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-cdf8d389-70d3-440a-8bb9-d14397f424f4 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:30.093792 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-cdf8d389-70d3-440a-8bb9-d14397f424f4 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:30.100519 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cdf8d389-70d3-440a-8bb9-d14397f424f4 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:30.101003 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cdf8d389-70d3-440a-8bb9-d14397f424f4 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:30.101433 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cdf8d389-70d3-440a-8bb9-d14397f424f4 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:30.102165 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cdf8d389-70d3-440a-8bb9-d14397f424f4 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:30.102611 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cdf8d389-70d3-440a-8bb9-d14397f424f4 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:30.103027 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-cdf8d389-70d3-440a-8bb9-d14397f424f4 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:30.236722 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-cdf8d389-70d3-440a-8bb9-d14397f424f4 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:02:30.244193 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-cdf8d389-70d3-440a-8bb9-d14397f424f4 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0" status: 200 len: 1318 microversion: 2.1 time: 0.154985 Aug 04 22:02:30.244752 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 640/1289] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:30 2022] GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:02:31.266496 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-17d16ef6-729b-42eb-9dac-7b53c644090b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:31.268273 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-17d16ef6-729b-42eb-9dac-7b53c644090b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:31.269660 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=2 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:02:31.274585 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-17d16ef6-729b-42eb-9dac-7b53c644090b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:31.275154 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-17d16ef6-729b-42eb-9dac-7b53c644090b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:31.275588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-17d16ef6-729b-42eb-9dac-7b53c644090b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:31.276286 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-17d16ef6-729b-42eb-9dac-7b53c644090b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:31.276745 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-17d16ef6-729b-42eb-9dac-7b53c644090b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:31.277167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-17d16ef6-729b-42eb-9dac-7b53c644090b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:31.409438 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-17d16ef6-729b-42eb-9dac-7b53c644090b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:02:31.417516 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-17d16ef6-729b-42eb-9dac-7b53c644090b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0" status: 200 len: 1318 microversion: 2.1 time: 0.155541 Aug 04 22:02:31.418794 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 650/1290] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:31 2022] GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:02:32.438974 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-99c7b540-0b03-4cdd-a774-3c1325ab6e15 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:32.439590 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-99c7b540-0b03-4cdd-a774-3c1325ab6e15 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:32.441472 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=2 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:02:32.442175 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=6 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:02:32.447608 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-99c7b540-0b03-4cdd-a774-3c1325ab6e15 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:32.448610 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-99c7b540-0b03-4cdd-a774-3c1325ab6e15 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:32.448610 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-99c7b540-0b03-4cdd-a774-3c1325ab6e15 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:32.449346 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-99c7b540-0b03-4cdd-a774-3c1325ab6e15 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:32.450650 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-99c7b540-0b03-4cdd-a774-3c1325ab6e15 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:32.451171 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-99c7b540-0b03-4cdd-a774-3c1325ab6e15 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:32.577509 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-4465e8b2-bae5-4464-b614-581077f50632 req-3c273079-dc6c-47aa-b0de-bea716e59f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0bef917-546a-4727-ac72-4496707a8de0", "name": "network-vif-plugged", "status": "completed", "tag": "84b461a7-d819-4cd6-adaf-e0af3361d0fd"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:02:32.586414 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-99c7b540-0b03-4cdd-a774-3c1325ab6e15 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:02:32.589628 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-4465e8b2-bae5-4464-b614-581077f50632 req-3c273079-dc6c-47aa-b0de-bea716e59f8d service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:32.591101 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-4465e8b2-bae5-4464-b614-581077f50632 req-3c273079-dc6c-47aa-b0de-bea716e59f8d service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:32.592018 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-4465e8b2-bae5-4464-b614-581077f50632 req-3c273079-dc6c-47aa-b0de-bea716e59f8d service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:32.594689 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-99c7b540-0b03-4cdd-a774-3c1325ab6e15 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0" status: 200 len: 1318 microversion: 2.1 time: 0.159799 Aug 04 22:02:32.595259 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 641/1291] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:32 2022] GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:02:32.605277 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-4465e8b2-bae5-4464-b614-581077f50632 req-3c273079-dc6c-47aa-b0de-bea716e59f8d service nova] Creating event network-vif-plugged:84b461a7-d819-4cd6-adaf-e0af3361d0fd for instance b0bef917-546a-4727-ac72-4496707a8de0 on hv-cinder-85220 Aug 04 22:02:32.612159 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-4465e8b2-bae5-4464-b614-581077f50632 req-3c273079-dc6c-47aa-b0de-bea716e59f8d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038897 Aug 04 22:02:32.612682 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 651/1292] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 22:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:02:33.616501 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a96ea6d7-1b91-4f08-a379-0e1bb497aa56 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:33.617089 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a96ea6d7-1b91-4f08-a379-0e1bb497aa56 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:33.625818 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a96ea6d7-1b91-4f08-a379-0e1bb497aa56 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:33.626332 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a96ea6d7-1b91-4f08-a379-0e1bb497aa56 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:33.626890 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a96ea6d7-1b91-4f08-a379-0e1bb497aa56 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:33.627582 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a96ea6d7-1b91-4f08-a379-0e1bb497aa56 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:33.628025 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a96ea6d7-1b91-4f08-a379-0e1bb497aa56 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:33.628439 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a96ea6d7-1b91-4f08-a379-0e1bb497aa56 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:33.765038 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a96ea6d7-1b91-4f08-a379-0e1bb497aa56 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:02:33.772459 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a96ea6d7-1b91-4f08-a379-0e1bb497aa56 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0" status: 200 len: 1318 microversion: 2.1 time: 0.159934 Aug 04 22:02:33.773015 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 642/1293] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:33 2022] GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:02:34.794120 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-0a35a6f3-d904-40c0-b76b-5412847d2f3e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:34.794821 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-0a35a6f3-d904-40c0-b76b-5412847d2f3e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:34.801145 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0a35a6f3-d904-40c0-b76b-5412847d2f3e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:34.801624 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0a35a6f3-d904-40c0-b76b-5412847d2f3e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:34.802084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0a35a6f3-d904-40c0-b76b-5412847d2f3e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:34.802783 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0a35a6f3-d904-40c0-b76b-5412847d2f3e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:34.803234 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0a35a6f3-d904-40c0-b76b-5412847d2f3e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:34.803686 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-0a35a6f3-d904-40c0-b76b-5412847d2f3e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:34.938626 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-0a35a6f3-d904-40c0-b76b-5412847d2f3e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:02:34.946161 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-0a35a6f3-d904-40c0-b76b-5412847d2f3e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0" status: 200 len: 1506 microversion: 2.1 time: 0.156927 Aug 04 22:02:34.946725 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 652/1294] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:02:34 2022] GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:02:34.967539 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-6a8b03de-4eef-4215-874c-6396190fa75b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e8c198a-ff62-4979-8aa6-ab719d51c26c", "device": "/dev/sdb"}} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:02:34.970593 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-6a8b03de-4eef-4215-874c-6396190fa75b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:34.977129 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6a8b03de-4eef-4215-874c-6396190fa75b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:34.977611 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6a8b03de-4eef-4215-874c-6396190fa75b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:34.978067 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6a8b03de-4eef-4215-874c-6396190fa75b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:34.978870 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6a8b03de-4eef-4215-874c-6396190fa75b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:34.979314 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6a8b03de-4eef-4215-874c-6396190fa75b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:34.979729 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-6a8b03de-4eef-4215-874c-6396190fa75b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:35.726663 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-6a8b03de-4eef-4215-874c-6396190fa75b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "POST /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.763444 Aug 04 22:02:35.727293 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 643/1295] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 4 22:02:34 2022] POST /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0/os-volume_attachments => generated 194 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:02:58.841129 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-1a3f4091-9148-4ec0-8462-621da0fc80af tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:02:58.841667 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-1a3f4091-9148-4ec0-8462-621da0fc80af tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:02:58.844467 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=18 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:02:58.845129 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=34 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:02:58.849751 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1a3f4091-9148-4ec0-8462-621da0fc80af tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:58.850276 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1a3f4091-9148-4ec0-8462-621da0fc80af tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:58.850741 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1a3f4091-9148-4ec0-8462-621da0fc80af tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:58.851431 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1a3f4091-9148-4ec0-8462-621da0fc80af tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:02:58.851896 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1a3f4091-9148-4ec0-8462-621da0fc80af tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:02:58.852299 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1a3f4091-9148-4ec0-8462-621da0fc80af tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:02:58.934466 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-1a3f4091-9148-4ec0-8462-621da0fc80af tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lazy-loading 'services' on Instance uuid b0bef917-546a-4727-ac72-4496707a8de0 {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:02:59.116559 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-1a3f4091-9148-4ec0-8462-621da0fc80af tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0/os-volume_attachments/3e8c198a-ff62-4979-8aa6-ab719d51c26c" status: 202 len: 0 microversion: 2.1 time: 0.279210 Aug 04 22:02:59.117115 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 653/1296] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 4 22:02:58 2022] DELETE /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0/os-volume_attachments/3e8c198a-ff62-4979-8aa6-ab719d51c26c => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:03:01.294455 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-4c3d08c7-eb53-483b-9aa2-4649e76273fa tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:03:01.295359 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-4c3d08c7-eb53-483b-9aa2-4649e76273fa tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:03:01.297582 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:03:01.298294 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:03:01.303188 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4c3d08c7-eb53-483b-9aa2-4649e76273fa tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:03:01.303672 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4c3d08c7-eb53-483b-9aa2-4649e76273fa tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:03:01.304104 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4c3d08c7-eb53-483b-9aa2-4649e76273fa tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:03:01.304794 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4c3d08c7-eb53-483b-9aa2-4649e76273fa tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:03:01.305245 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4c3d08c7-eb53-483b-9aa2-4649e76273fa tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:03:01.305666 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-4c3d08c7-eb53-483b-9aa2-4649e76273fa tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:03:01.331729 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-4c3d08c7-eb53-483b-9aa2-4649e76273fa tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Going to try to terminate instance {{(pid=136341) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:03:01.610840 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-4c3d08c7-eb53-483b-9aa2-4649e76273fa tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0" status: 204 len: 0 microversion: 2.1 time: 0.320323 Aug 04 22:03:01.611430 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 644/1297] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 22:03:01 2022] DELETE /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:03:01.620790 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-1556beee-ab09-4393-9f13-e39111cc6a7d tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:03:01.621510 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-1556beee-ab09-4393-9f13-e39111cc6a7d tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:03:01.628914 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1556beee-ab09-4393-9f13-e39111cc6a7d tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:03:01.629405 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1556beee-ab09-4393-9f13-e39111cc6a7d tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:03:01.633211 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1556beee-ab09-4393-9f13-e39111cc6a7d tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:03:01.633211 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1556beee-ab09-4393-9f13-e39111cc6a7d tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:03:01.633211 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1556beee-ab09-4393-9f13-e39111cc6a7d tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:03:01.633211 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1556beee-ab09-4393-9f13-e39111cc6a7d tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:03:01.767501 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1556beee-ab09-4393-9f13-e39111cc6a7d tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:03:01.775098 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-1556beee-ab09-4393-9f13-e39111cc6a7d tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0" status: 200 len: 1512 microversion: 2.1 time: 0.159066 Aug 04 22:03:01.775599 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 654/1298] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:03:01 2022] GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:03:02.797692 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a9006490-a369-4061-bd93-73e76938c19b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:03:02.798327 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a9006490-a369-4061-bd93-73e76938c19b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:03:02.805065 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a9006490-a369-4061-bd93-73e76938c19b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:03:02.805542 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a9006490-a369-4061-bd93-73e76938c19b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:03:02.806446 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a9006490-a369-4061-bd93-73e76938c19b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:03:02.807175 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a9006490-a369-4061-bd93-73e76938c19b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:03:02.807620 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a9006490-a369-4061-bd93-73e76938c19b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:03:02.808035 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a9006490-a369-4061-bd93-73e76938c19b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:03:02.962343 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a9006490-a369-4061-bd93-73e76938c19b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:03:02.971531 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a9006490-a369-4061-bd93-73e76938c19b tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0" status: 200 len: 1512 microversion: 2.1 time: 0.178976 Aug 04 22:03:02.972108 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 645/1299] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:03:02 2022] GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0 => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:03:03.993138 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-1185edbb-4b30-4a18-b9a0-0f32ed291a8e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:03:03.993763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-1185edbb-4b30-4a18-b9a0-0f32ed291a8e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:03:04.000988 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1185edbb-4b30-4a18-b9a0-0f32ed291a8e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:03:04.001478 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1185edbb-4b30-4a18-b9a0-0f32ed291a8e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:03:04.001909 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1185edbb-4b30-4a18-b9a0-0f32ed291a8e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:03:04.002627 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1185edbb-4b30-4a18-b9a0-0f32ed291a8e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:03:04.003085 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1185edbb-4b30-4a18-b9a0-0f32ed291a8e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:03:04.003509 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1185edbb-4b30-4a18-b9a0-0f32ed291a8e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:03:04.147966 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1185edbb-4b30-4a18-b9a0-0f32ed291a8e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:03:04.157107 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-1185edbb-4b30-4a18-b9a0-0f32ed291a8e tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0" status: 200 len: 1512 microversion: 2.1 time: 0.167791 Aug 04 22:03:04.160190 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 655/1300] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:03:03 2022] GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0 => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:03:04.584295 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-ddba7e5f-58e6-4c2e-ae6e-c7368b255712 req-4424c653-627a-4693-86f5-b3511bad063c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0bef917-546a-4727-ac72-4496707a8de0", "name": "network-vif-deleted", "tag": "84b461a7-d819-4cd6-adaf-e0af3361d0fd"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:03:04.594856 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-ddba7e5f-58e6-4c2e-ae6e-c7368b255712 req-4424c653-627a-4693-86f5-b3511bad063c service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:03:04.596104 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-ddba7e5f-58e6-4c2e-ae6e-c7368b255712 req-4424c653-627a-4693-86f5-b3511bad063c service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:03:04.596104 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-ddba7e5f-58e6-4c2e-ae6e-c7368b255712 req-4424c653-627a-4693-86f5-b3511bad063c service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:03:04.606684 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-ddba7e5f-58e6-4c2e-ae6e-c7368b255712 req-4424c653-627a-4693-86f5-b3511bad063c service nova] Creating event network-vif-deleted:84b461a7-d819-4cd6-adaf-e0af3361d0fd for instance b0bef917-546a-4727-ac72-4496707a8de0 on hv-cinder-85220 Aug 04 22:03:04.611915 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-ddba7e5f-58e6-4c2e-ae6e-c7368b255712 req-4424c653-627a-4693-86f5-b3511bad063c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031365 Aug 04 22:03:04.612507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 646/1301] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 22:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:03:05.178247 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-452b3c57-0dc1-4ad5-91e9-d16b1f4a2971 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:03:05.178848 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-452b3c57-0dc1-4ad5-91e9-d16b1f4a2971 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:03:05.185084 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-452b3c57-0dc1-4ad5-91e9-d16b1f4a2971 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:03:05.186128 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-452b3c57-0dc1-4ad5-91e9-d16b1f4a2971 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:03:05.186862 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-452b3c57-0dc1-4ad5-91e9-d16b1f4a2971 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:03:05.187563 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-452b3c57-0dc1-4ad5-91e9-d16b1f4a2971 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:03:05.188021 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-452b3c57-0dc1-4ad5-91e9-d16b1f4a2971 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:03:05.188444 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-452b3c57-0dc1-4ad5-91e9-d16b1f4a2971 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:03:05.219473 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-452b3c57-0dc1-4ad5-91e9-d16b1f4a2971 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:03:05.219954 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-452b3c57-0dc1-4ad5-91e9-d16b1f4a2971 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:03:05.220390 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-452b3c57-0dc1-4ad5-91e9-d16b1f4a2971 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:03:05.220838 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-452b3c57-0dc1-4ad5-91e9-d16b1f4a2971 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lazy-loading 'fault' on Instance uuid b0bef917-546a-4727-ac72-4496707a8de0 {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:03:05.267030 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-452b3c57-0dc1-4ad5-91e9-d16b1f4a2971 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037873250f324a82ba88d4ee151bfa2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e75154a4e9e4562b0757fc22af26d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:03:05.274505 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-452b3c57-0dc1-4ad5-91e9-d16b1f4a2971 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0" status: 200 len: 1308 microversion: 2.1 time: 0.100207 Aug 04 22:03:05.275074 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 656/1302] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:03:05 2022] GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:03:06.297362 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-9d53ea25-1ad3-49ca-8f8e-a9ee52a6d203 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:03:06.298077 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-9d53ea25-1ad3-49ca-8f8e-a9ee52a6d203 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] [instance: b0bef917-546a-4727-ac72-4496707a8de0] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:03:06.304854 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9d53ea25-1ad3-49ca-8f8e-a9ee52a6d203 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:03:06.305360 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9d53ea25-1ad3-49ca-8f8e-a9ee52a6d203 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:03:06.305791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9d53ea25-1ad3-49ca-8f8e-a9ee52a6d203 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:03:06.306539 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9d53ea25-1ad3-49ca-8f8e-a9ee52a6d203 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:03:06.306981 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9d53ea25-1ad3-49ca-8f8e-a9ee52a6d203 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:03:06.307398 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9d53ea25-1ad3-49ca-8f8e-a9ee52a6d203 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:03:06.321713 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-9d53ea25-1ad3-49ca-8f8e-a9ee52a6d203 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] HTTP exception thrown: Instance b0bef917-546a-4727-ac72-4496707a8de0 could not be found. Aug 04 22:03:06.323364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-9d53ea25-1ad3-49ca-8f8e-a9ee52a6d203 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Request method failure captured: Aug 04 22:03:06.323364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0 HTTP/1.1 Aug 04 22:03:06.323364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 22:03:06.323364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 22:03:06.323364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 22:03:06.323364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 22:03:06.323364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 22:03:06.323364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 22:03:06.323364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 22:03:06.323364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 22:03:06.323364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7EGUkfS7fjw7QbjdTMES1uIMOa1Frh9zsc7bLWBulni6wEs3V7dFPDSjS4b_TnAEhog5h1_VvGA-tLykkPYINPAdjepNk0MOqErO_Aep8y6O0ffcUrqupn-ovyIPJnNNOzMy9mqy3zgCN8C_C9UM5a8WdepyjmVBO91T2S6bqJ24LZ8 Aug 04 22:03:06.323364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 22:03:06.323364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 22:03:06.323364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 22:03:06.323364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 22:03:06.323364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 22:03:06.323364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 22:03:06.323364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: 0e75154a4e9e4562b0757fc22af26d1e Aug 04 22:03:06.323364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-VolumesSnapshotTestJSON-594106867 Aug 04 22:03:06.323364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 22:03:06.323364 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 22:03:06.324955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0e75154a4e9e4562b0757fc22af26d1e", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0e75154a4e9e4562b0757fc22af26d1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0e75154a4e9e4562b0757fc22af26d1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0e75154a4e9e4562b0757fc22af26d1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 22:03:06.324955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-VolumesSnapshotTestJSON-594106867 Aug 04 22:03:06.324955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: 0e75154a4e9e4562b0757fc22af26d1e Aug 04 22:03:06.324955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-594106867 Aug 04 22:03:06.324955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-VolumesSnapshotTestJSON-594106867-project Aug 04 22:03:06.324955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 22:03:06.324955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 22:03:06.324955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: 037873250f324a82ba88d4ee151bfa2e Aug 04 22:03:06.324955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-VolumesSnapshotTestJSON-594106867-project Aug 04 22:03:06.324955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 22:03:06.324955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Instance b0bef917-546a-4727-ac72-4496707a8de0 could not be found. Aug 04 22:03:06.324955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': 'b0bef917-546a-4727-ac72-4496707a8de0'} Aug 04 22:03:06.325866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:03:06.325866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:03:06.325866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:03:06.325866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:03:06.325866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:03:06.325866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:03:06.325866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:03:06.325866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:03:06.325866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:03:06.325866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:03:06.325866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0bef917-546a-4727-ac72-4496707a8de0 could not be found. Aug 04 22:03:06.325866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 22:03:06.325866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:03:06.325866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 22:03:06.325866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:03:06.325866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:03:06.325866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:03:06.325866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:03:06.325866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:03:06.325866 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:03:06.327862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:03:06.327862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:03:06.327862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:03:06.327862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:03:06.327862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:03:06.327862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:03:06.327862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:03:06.327862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0bef917-546a-4727-ac72-4496707a8de0 could not be found. Aug 04 22:03:06.327862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 22:03:06.327862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:03:06.327862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 22:03:06.327862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:03:06.327862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:03:06.327862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:03:06.327862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:03:06.327862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:03:06.327862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0bef917-546a-4727-ac72-4496707a8de0 could not be found. Aug 04 22:03:06.327862 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 22:03:06.329471 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-9d53ea25-1ad3-49ca-8f8e-a9ee52a6d203 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] Returning 404 to user: Instance b0bef917-546a-4727-ac72-4496707a8de0 could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:03:06.329471 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-9d53ea25-1ad3-49ca-8f8e-a9ee52a6d203 tempest-VolumesSnapshotTestJSON-594106867 tempest-VolumesSnapshotTestJSON-594106867-project] 10.222.0.73 "GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0" status: 404 len: 111 microversion: 2.1 time: 0.032779 Aug 04 22:03:06.329471 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 647/1303] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:03:06 2022] GET /compute/v2.1/servers/b0bef917-546a-4727-ac72-4496707a8de0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:03:43.349457 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:03:43.350124 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Thu Aug 4 22:03:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:04:20.147461 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=10 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:04:20.148207 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:04:20.152383 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f5d249de-48a3-4a40-a00b-852b96057e74 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1212484149", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1795731597", "security_groups": [{"name": "tempest-secgroup-smoke-965852390"}], "block_device_mapping_v2": [{"uuid": "28e2d77f-24e2-4f45-b25c-1422ec1c39b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4dc06773-9775-4bb6-a3f2-6c12854b5693"}]}} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:04:20.271262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.network.neutron [None req-f5d249de-48a3-4a40-a00b-852b96057e74 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] validate_networks() for [('4dc06773-9775-4bb6-a3f2-6c12854b5693', None, None, None, None, None)] {{(pid=136342) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 22:04:20.670489 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-f5d249de-48a3-4a40-a00b-852b96057e74 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Flavor limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 22:04:20.670909 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-f5d249de-48a3-4a40-a00b-852b96057e74 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Image limits 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 22:04:20.671373 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-f5d249de-48a3-4a40-a00b-852b96057e74 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Flavor pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 22:04:20.671771 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-f5d249de-48a3-4a40-a00b-852b96057e74 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Image pref 0:0:0 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 22:04:20.672197 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.virt.hardware [None req-f5d249de-48a3-4a40-a00b-852b96057e74 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 22:04:20.682445 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f5d249de-48a3-4a40-a00b-852b96057e74 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:20.682929 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f5d249de-48a3-4a40-a00b-852b96057e74 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:20.683362 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f5d249de-48a3-4a40-a00b-852b96057e74 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:20.684095 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f5d249de-48a3-4a40-a00b-852b96057e74 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:20.684547 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f5d249de-48a3-4a40-a00b-852b96057e74 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:20.684966 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f5d249de-48a3-4a40-a00b-852b96057e74 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:20.702780 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-f5d249de-48a3-4a40-a00b-852b96057e74 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Getting quotas for project ee8894a750724fb987a01514be0ab39b. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 22:04:20.706830 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.quota [None req-f5d249de-48a3-4a40-a00b-852b96057e74 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Getting quotas for user 292eee6c79214436962643db0a840708 and project ee8894a750724fb987a01514be0ab39b. Resources: {'instances', 'cores', 'ram'} {{(pid=136342) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 22:04:20.767961 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-f5d249de-48a3-4a40-a00b-852b96057e74 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Going to run 1 instances... {{(pid=136342) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 22:04:20.770579 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-f5d249de-48a3-4a40-a00b-852b96057e74 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='28e2d77f-24e2-4f45-b25c-1422ec1c39b3',volume_size=None,volume_type=None)] {{(pid=136342) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 22:04:21.152045 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-f5d249de-48a3-4a40-a00b-852b96057e74 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.006198 Aug 04 22:04:21.152764 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 657/1304] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 4 22:04:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 22:04:21.162407 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:04:21.163355 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:04:21.168163 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-0718f358-0f49-414d-b364-5568620ab877 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:04:21.168795 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-0718f358-0f49-414d-b364-5568620ab877 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:04:21.235462 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-0718f358-0f49-414d-b364-5568620ab877 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:04:21.243275 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-0718f358-0f49-414d-b364-5568620ab877 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1095 microversion: 2.1 time: 0.082937 Aug 04 22:04:21.243841 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 648/1305] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:04:21 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1095 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:04:22.264901 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b194304f-f2e7-4f5e-a2a4-09d7541fdf90 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:04:22.265494 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b194304f-f2e7-4f5e-a2a4-09d7541fdf90 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:04:22.273178 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b194304f-f2e7-4f5e-a2a4-09d7541fdf90 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:22.273705 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b194304f-f2e7-4f5e-a2a4-09d7541fdf90 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:22.274174 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b194304f-f2e7-4f5e-a2a4-09d7541fdf90 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:22.274883 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b194304f-f2e7-4f5e-a2a4-09d7541fdf90 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:22.275328 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b194304f-f2e7-4f5e-a2a4-09d7541fdf90 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:22.275749 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b194304f-f2e7-4f5e-a2a4-09d7541fdf90 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:22.343649 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b194304f-f2e7-4f5e-a2a4-09d7541fdf90 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:04:22.352726 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b194304f-f2e7-4f5e-a2a4-09d7541fdf90 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1145 microversion: 2.1 time: 0.092151 Aug 04 22:04:22.353798 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 658/1306] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:04:22 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1145 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:04:23.373025 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-baa39909-0c92-44c3-8f93-7a1b6bc43b38 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:04:23.373628 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-baa39909-0c92-44c3-8f93-7a1b6bc43b38 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:04:23.383666 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-baa39909-0c92-44c3-8f93-7a1b6bc43b38 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:23.384117 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-baa39909-0c92-44c3-8f93-7a1b6bc43b38 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:23.384569 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-baa39909-0c92-44c3-8f93-7a1b6bc43b38 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:23.385256 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-baa39909-0c92-44c3-8f93-7a1b6bc43b38 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:23.385696 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-baa39909-0c92-44c3-8f93-7a1b6bc43b38 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:23.386146 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-baa39909-0c92-44c3-8f93-7a1b6bc43b38 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:23.477205 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-baa39909-0c92-44c3-8f93-7a1b6bc43b38 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:04:23.484869 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-baa39909-0c92-44c3-8f93-7a1b6bc43b38 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1201 microversion: 2.1 time: 0.116033 Aug 04 22:04:23.485428 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 649/1307] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:04:23 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1201 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:04:24.507144 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8613bfec-1cdd-4711-9a78-9f25f8814828 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:04:24.507762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8613bfec-1cdd-4711-9a78-9f25f8814828 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:04:24.514598 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8613bfec-1cdd-4711-9a78-9f25f8814828 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:24.515052 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8613bfec-1cdd-4711-9a78-9f25f8814828 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:24.515493 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8613bfec-1cdd-4711-9a78-9f25f8814828 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:24.516195 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8613bfec-1cdd-4711-9a78-9f25f8814828 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:24.516648 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8613bfec-1cdd-4711-9a78-9f25f8814828 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:24.517076 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8613bfec-1cdd-4711-9a78-9f25f8814828 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:24.665523 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-8613bfec-1cdd-4711-9a78-9f25f8814828 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:04:24.673299 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8613bfec-1cdd-4711-9a78-9f25f8814828 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1278 microversion: 2.1 time: 0.170787 Aug 04 22:04:24.673802 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 659/1308] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:04:24 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:04:25.127042 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-b9f2521e-fd66-4cc1-95bc-e5ef53644860 req-ef476641-f2be-43cd-96dc-b721525073c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88b5d6ea-c4bc-44c8-a68d-9d19f09ab930", "tag": "a45ce1ee-4208-4a19-9ed8-3145f8d6c124"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:04:25.138675 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-b9f2521e-fd66-4cc1-95bc-e5ef53644860 req-ef476641-f2be-43cd-96dc-b721525073c2 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:25.139126 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-b9f2521e-fd66-4cc1-95bc-e5ef53644860 req-ef476641-f2be-43cd-96dc-b721525073c2 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:25.139546 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-b9f2521e-fd66-4cc1-95bc-e5ef53644860 req-ef476641-f2be-43cd-96dc-b721525073c2 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:25.154883 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-b9f2521e-fd66-4cc1-95bc-e5ef53644860 req-ef476641-f2be-43cd-96dc-b721525073c2 service nova] Creating event network-changed:a45ce1ee-4208-4a19-9ed8-3145f8d6c124 for instance 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 on hv-cinder-85220 Aug 04 22:04:25.160817 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-b9f2521e-fd66-4cc1-95bc-e5ef53644860 req-ef476641-f2be-43cd-96dc-b721525073c2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037627 Aug 04 22:04:25.161404 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 650/1309] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 22:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:04:25.699841 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-08c0ee59-bc8f-4271-b5c8-3f843ef0af53 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:04:25.700477 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-08c0ee59-bc8f-4271-b5c8-3f843ef0af53 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:04:25.707277 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c0ee59-bc8f-4271-b5c8-3f843ef0af53 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:25.708631 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c0ee59-bc8f-4271-b5c8-3f843ef0af53 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:25.708631 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c0ee59-bc8f-4271-b5c8-3f843ef0af53 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:25.709044 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c0ee59-bc8f-4271-b5c8-3f843ef0af53 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:25.709326 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c0ee59-bc8f-4271-b5c8-3f843ef0af53 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:25.709747 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-08c0ee59-bc8f-4271-b5c8-3f843ef0af53 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:25.853088 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-08c0ee59-bc8f-4271-b5c8-3f843ef0af53 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:04:25.860963 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-08c0ee59-bc8f-4271-b5c8-3f843ef0af53 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1266 microversion: 2.1 time: 0.165015 Aug 04 22:04:25.861538 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 660/1310] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:04:25 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:04:26.884201 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-84d8ef92-92d5-4515-8bf8-095abca3570e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:04:26.884811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-84d8ef92-92d5-4515-8bf8-095abca3570e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:04:26.891904 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-84d8ef92-92d5-4515-8bf8-095abca3570e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:26.892387 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-84d8ef92-92d5-4515-8bf8-095abca3570e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:26.892816 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-84d8ef92-92d5-4515-8bf8-095abca3570e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:26.893514 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-84d8ef92-92d5-4515-8bf8-095abca3570e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:26.894908 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-84d8ef92-92d5-4515-8bf8-095abca3570e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:26.895510 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-84d8ef92-92d5-4515-8bf8-095abca3570e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:27.032509 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-84d8ef92-92d5-4515-8bf8-095abca3570e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:04:27.043613 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-84d8ef92-92d5-4515-8bf8-095abca3570e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1266 microversion: 2.1 time: 0.160489 Aug 04 22:04:27.043613 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 651/1311] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:04:26 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:04:28.062379 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-2ebe28ec-ac73-4e5f-a5c8-ec5677f3e8da tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:04:28.063014 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-2ebe28ec-ac73-4e5f-a5c8-ec5677f3e8da tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:04:28.069708 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2ebe28ec-ac73-4e5f-a5c8-ec5677f3e8da tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:28.070237 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2ebe28ec-ac73-4e5f-a5c8-ec5677f3e8da tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:28.070675 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2ebe28ec-ac73-4e5f-a5c8-ec5677f3e8da tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:28.071374 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2ebe28ec-ac73-4e5f-a5c8-ec5677f3e8da tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:28.071826 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2ebe28ec-ac73-4e5f-a5c8-ec5677f3e8da tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:28.072248 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-2ebe28ec-ac73-4e5f-a5c8-ec5677f3e8da tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:28.208411 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-2ebe28ec-ac73-4e5f-a5c8-ec5677f3e8da tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:04:28.216033 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-2ebe28ec-ac73-4e5f-a5c8-ec5677f3e8da tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1266 microversion: 2.1 time: 0.157649 Aug 04 22:04:28.216605 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 661/1312] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:04:28 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:04:29.236536 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-44007fa9-2aec-4f3f-927f-ca376af04065 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:04:29.237133 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-44007fa9-2aec-4f3f-927f-ca376af04065 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:04:29.244281 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-44007fa9-2aec-4f3f-927f-ca376af04065 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:29.244757 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-44007fa9-2aec-4f3f-927f-ca376af04065 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:29.245185 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-44007fa9-2aec-4f3f-927f-ca376af04065 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:29.245878 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-44007fa9-2aec-4f3f-927f-ca376af04065 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:29.246354 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-44007fa9-2aec-4f3f-927f-ca376af04065 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:29.247051 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-44007fa9-2aec-4f3f-927f-ca376af04065 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:29.378566 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-44007fa9-2aec-4f3f-927f-ca376af04065 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:04:29.386046 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-44007fa9-2aec-4f3f-927f-ca376af04065 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1266 microversion: 2.1 time: 0.153295 Aug 04 22:04:29.386673 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 652/1313] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:04:29 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:04:30.407345 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-163bba59-fb53-4d93-af21-0f6f08420d0e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:04:30.407969 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-163bba59-fb53-4d93-af21-0f6f08420d0e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:04:30.415291 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-163bba59-fb53-4d93-af21-0f6f08420d0e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:30.415783 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-163bba59-fb53-4d93-af21-0f6f08420d0e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:30.416226 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-163bba59-fb53-4d93-af21-0f6f08420d0e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:30.416924 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-163bba59-fb53-4d93-af21-0f6f08420d0e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:30.417377 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-163bba59-fb53-4d93-af21-0f6f08420d0e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:30.417800 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-163bba59-fb53-4d93-af21-0f6f08420d0e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:30.555697 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-163bba59-fb53-4d93-af21-0f6f08420d0e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:04:30.563393 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-163bba59-fb53-4d93-af21-0f6f08420d0e tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1266 microversion: 2.1 time: 0.159884 Aug 04 22:04:30.563965 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 662/1314] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:04:30 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:04:31.585576 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ebffcd38-3fab-42df-835f-cc3e2b0f54bf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:04:31.586219 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-ebffcd38-3fab-42df-835f-cc3e2b0f54bf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:04:31.588625 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell0:SELECT=2 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:04:31.593313 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ebffcd38-3fab-42df-835f-cc3e2b0f54bf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:31.593793 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ebffcd38-3fab-42df-835f-cc3e2b0f54bf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:31.594259 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ebffcd38-3fab-42df-835f-cc3e2b0f54bf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:31.594953 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ebffcd38-3fab-42df-835f-cc3e2b0f54bf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:31.595402 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ebffcd38-3fab-42df-835f-cc3e2b0f54bf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:31.595829 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-ebffcd38-3fab-42df-835f-cc3e2b0f54bf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:31.734664 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-ebffcd38-3fab-42df-835f-cc3e2b0f54bf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:04:31.742752 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ebffcd38-3fab-42df-835f-cc3e2b0f54bf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1266 microversion: 2.1 time: 0.161762 Aug 04 22:04:31.743324 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 653/1315] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:04:31 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:04:32.764671 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-20d13389-a25e-45b1-ab1e-6c304b946940 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:04:32.765367 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-20d13389-a25e-45b1-ab1e-6c304b946940 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:04:32.767145 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=2 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:04:32.767868 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell0:SELECT=6 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:04:32.780827 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-20d13389-a25e-45b1-ab1e-6c304b946940 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:32.780827 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-20d13389-a25e-45b1-ab1e-6c304b946940 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:32.780827 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-20d13389-a25e-45b1-ab1e-6c304b946940 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:32.780827 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-20d13389-a25e-45b1-ab1e-6c304b946940 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:32.781367 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-20d13389-a25e-45b1-ab1e-6c304b946940 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:32.781367 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-20d13389-a25e-45b1-ab1e-6c304b946940 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:32.916104 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-20d13389-a25e-45b1-ab1e-6c304b946940 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:04:32.923597 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-20d13389-a25e-45b1-ab1e-6c304b946940 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1266 microversion: 2.1 time: 0.162771 Aug 04 22:04:32.924163 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 663/1316] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:04:32 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:04:33.945218 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-a2ddf162-3222-4dda-9c24-2f12b527aff1 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:04:33.945853 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-a2ddf162-3222-4dda-9c24-2f12b527aff1 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:04:33.952187 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a2ddf162-3222-4dda-9c24-2f12b527aff1 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:33.952672 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a2ddf162-3222-4dda-9c24-2f12b527aff1 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:33.953100 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a2ddf162-3222-4dda-9c24-2f12b527aff1 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:33.953786 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a2ddf162-3222-4dda-9c24-2f12b527aff1 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:33.954254 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a2ddf162-3222-4dda-9c24-2f12b527aff1 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:33.954674 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-a2ddf162-3222-4dda-9c24-2f12b527aff1 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:34.087439 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-a2ddf162-3222-4dda-9c24-2f12b527aff1 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:04:34.094965 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-a2ddf162-3222-4dda-9c24-2f12b527aff1 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1266 microversion: 2.1 time: 0.154190 Aug 04 22:04:34.095520 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 654/1317] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:04:33 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:04:35.116461 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-77579a62-ec38-497a-90b3-1601db1a621c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:04:35.117152 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-77579a62-ec38-497a-90b3-1601db1a621c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:04:35.124241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-77579a62-ec38-497a-90b3-1601db1a621c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:35.124807 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-77579a62-ec38-497a-90b3-1601db1a621c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:35.125238 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-77579a62-ec38-497a-90b3-1601db1a621c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:35.125932 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-77579a62-ec38-497a-90b3-1601db1a621c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:35.126407 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-77579a62-ec38-497a-90b3-1601db1a621c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:35.126821 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-77579a62-ec38-497a-90b3-1601db1a621c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:35.264011 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-77579a62-ec38-497a-90b3-1601db1a621c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:04:35.272385 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-77579a62-ec38-497a-90b3-1601db1a621c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1266 microversion: 2.1 time: 0.160232 Aug 04 22:04:35.272968 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 664/1318] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:04:35 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:04:36.294405 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-c0dd1f8f-5421-4536-a1ca-1b7eb3ada05a tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:04:36.295012 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-c0dd1f8f-5421-4536-a1ca-1b7eb3ada05a tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:04:36.301869 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c0dd1f8f-5421-4536-a1ca-1b7eb3ada05a tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:36.302486 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c0dd1f8f-5421-4536-a1ca-1b7eb3ada05a tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:36.302913 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c0dd1f8f-5421-4536-a1ca-1b7eb3ada05a tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:36.303601 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c0dd1f8f-5421-4536-a1ca-1b7eb3ada05a tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:36.304043 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c0dd1f8f-5421-4536-a1ca-1b7eb3ada05a tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:36.304458 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-c0dd1f8f-5421-4536-a1ca-1b7eb3ada05a tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:36.442559 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-c0dd1f8f-5421-4536-a1ca-1b7eb3ada05a tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:04:36.450212 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-c0dd1f8f-5421-4536-a1ca-1b7eb3ada05a tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1266 microversion: 2.1 time: 0.159706 Aug 04 22:04:36.459749 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 655/1319] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:04:36 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:04:37.343320 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-396d7e27-5be0-4e65-badd-90789495dde4 req-b79017ad-566e-411b-b5b1-98d2baa2e7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b5d6ea-c4bc-44c8-a68d-9d19f09ab930", "name": "network-vif-plugged", "status": "completed", "tag": "a45ce1ee-4208-4a19-9ed8-3145f8d6c124"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:04:37.353296 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-396d7e27-5be0-4e65-badd-90789495dde4 req-b79017ad-566e-411b-b5b1-98d2baa2e7f5 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:37.353768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-396d7e27-5be0-4e65-badd-90789495dde4 req-b79017ad-566e-411b-b5b1-98d2baa2e7f5 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:37.354222 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-396d7e27-5be0-4e65-badd-90789495dde4 req-b79017ad-566e-411b-b5b1-98d2baa2e7f5 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:37.366053 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-396d7e27-5be0-4e65-badd-90789495dde4 req-b79017ad-566e-411b-b5b1-98d2baa2e7f5 service nova] Creating event network-vif-plugged:a45ce1ee-4208-4a19-9ed8-3145f8d6c124 for instance 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 on hv-cinder-85220 Aug 04 22:04:37.371294 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-396d7e27-5be0-4e65-badd-90789495dde4 req-b79017ad-566e-411b-b5b1-98d2baa2e7f5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151899 Aug 04 22:04:37.372204 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 665/1320] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 22:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:04:37.472317 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-2cf9a11e-25e7-41af-a1b7-91266003bbe7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:04:37.472991 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-2cf9a11e-25e7-41af-a1b7-91266003bbe7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:04:37.479579 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2cf9a11e-25e7-41af-a1b7-91266003bbe7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:37.480062 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2cf9a11e-25e7-41af-a1b7-91266003bbe7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:37.480496 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2cf9a11e-25e7-41af-a1b7-91266003bbe7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:37.481190 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2cf9a11e-25e7-41af-a1b7-91266003bbe7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:37.481636 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2cf9a11e-25e7-41af-a1b7-91266003bbe7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:37.482088 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-2cf9a11e-25e7-41af-a1b7-91266003bbe7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:37.621197 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-2cf9a11e-25e7-41af-a1b7-91266003bbe7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:04:37.630297 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-2cf9a11e-25e7-41af-a1b7-91266003bbe7 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1266 microversion: 2.1 time: 0.162082 Aug 04 22:04:37.630979 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 656/1321] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:04:37 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:04:38.665215 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-c0d77374-f5c8-4a15-afbf-7119624be2a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:04:38.665948 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-c0d77374-f5c8-4a15-afbf-7119624be2a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:04:38.672196 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c0d77374-f5c8-4a15-afbf-7119624be2a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:38.672668 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c0d77374-f5c8-4a15-afbf-7119624be2a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:38.673099 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c0d77374-f5c8-4a15-afbf-7119624be2a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:38.673785 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c0d77374-f5c8-4a15-afbf-7119624be2a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:38.674281 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c0d77374-f5c8-4a15-afbf-7119624be2a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:38.675385 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-c0d77374-f5c8-4a15-afbf-7119624be2a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:38.811392 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-c0d77374-f5c8-4a15-afbf-7119624be2a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:04:38.819590 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-c0d77374-f5c8-4a15-afbf-7119624be2a9 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1266 microversion: 2.1 time: 0.160439 Aug 04 22:04:38.820146 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 666/1322] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:04:38 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:04:39.840716 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-dfd6ac39-1928-41ea-a228-6a91f0c4de68 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:04:39.841329 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-dfd6ac39-1928-41ea-a228-6a91f0c4de68 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:04:39.852884 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dfd6ac39-1928-41ea-a228-6a91f0c4de68 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:39.853382 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dfd6ac39-1928-41ea-a228-6a91f0c4de68 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:39.853816 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dfd6ac39-1928-41ea-a228-6a91f0c4de68 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:39.854565 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dfd6ac39-1928-41ea-a228-6a91f0c4de68 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:39.855012 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dfd6ac39-1928-41ea-a228-6a91f0c4de68 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:39.855435 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-dfd6ac39-1928-41ea-a228-6a91f0c4de68 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:39.990669 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-dfd6ac39-1928-41ea-a228-6a91f0c4de68 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:04:39.998774 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-dfd6ac39-1928-41ea-a228-6a91f0c4de68 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1454 microversion: 2.1 time: 0.161914 Aug 04 22:04:39.999333 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 657/1323] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:04:39 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:04:40.019393 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-b71ae9d9-d1b1-4414-8205-35f43af3dbcd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:04:40.020032 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-b71ae9d9-d1b1-4414-8205-35f43af3dbcd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:04:40.026464 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b71ae9d9-d1b1-4414-8205-35f43af3dbcd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:40.026946 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b71ae9d9-d1b1-4414-8205-35f43af3dbcd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:40.027382 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b71ae9d9-d1b1-4414-8205-35f43af3dbcd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:40.028075 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b71ae9d9-d1b1-4414-8205-35f43af3dbcd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:40.028531 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b71ae9d9-d1b1-4414-8205-35f43af3dbcd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:40.028954 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-b71ae9d9-d1b1-4414-8205-35f43af3dbcd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:40.174737 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-b71ae9d9-d1b1-4414-8205-35f43af3dbcd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:04:40.183377 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-b71ae9d9-d1b1-4414-8205-35f43af3dbcd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1454 microversion: 2.1 time: 0.167718 Aug 04 22:04:40.183959 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 667/1324] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:04:40 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:04:42.608418 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-b71cebd7-c421-45a4-86c2-c5d696af4923 req-16bca608-10fd-4265-b3fb-6ccda833a86d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88b5d6ea-c4bc-44c8-a68d-9d19f09ab930", "tag": "a45ce1ee-4208-4a19-9ed8-3145f8d6c124"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:04:42.618283 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-b71cebd7-c421-45a4-86c2-c5d696af4923 req-16bca608-10fd-4265-b3fb-6ccda833a86d service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:04:42.618756 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-b71cebd7-c421-45a4-86c2-c5d696af4923 req-16bca608-10fd-4265-b3fb-6ccda833a86d service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:04:42.619183 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-b71cebd7-c421-45a4-86c2-c5d696af4923 req-16bca608-10fd-4265-b3fb-6ccda833a86d service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:04:42.631520 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-b71cebd7-c421-45a4-86c2-c5d696af4923 req-16bca608-10fd-4265-b3fb-6ccda833a86d service nova] Creating event network-changed:a45ce1ee-4208-4a19-9ed8-3145f8d6c124 for instance 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 on hv-cinder-85220 Aug 04 22:04:42.636673 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-b71cebd7-c421-45a4-86c2-c5d696af4923 req-16bca608-10fd-4265-b3fb-6ccda833a86d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092677 Aug 04 22:04:42.637470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 658/1325] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 22:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:05:27.544327 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:05:27.545137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Thu Aug 4 22:05:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:05:35.266799 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:05:35.267566 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Thu Aug 4 22:05:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:06:32.388028 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:06:32.389785 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG dbcounter [-] [136342] Writing DB stats nova_cell1:SELECT=58 {{(pid=136342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:06:32.390921 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_api:SELECT=24 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:06:32.391848 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG dbcounter [-] [136341] Writing DB stats nova_cell1:SELECT=52 {{(pid=136341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:06:32.394270 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-a6443e9d-cf45-4b21-ad49-93cedff62a23 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:06:32.394844 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-a6443e9d-cf45-4b21-ad49-93cedff62a23 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:06:32.396799 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-d3c6556e-c5b1-4843-97fd-5b5e7b1a2fab req-f62e8fa0-37ad-4d69-80be-f2a3a7773e7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88b5d6ea-c4bc-44c8-a68d-9d19f09ab930", "tag": "a45ce1ee-4208-4a19-9ed8-3145f8d6c124"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:06:32.401037 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a6443e9d-cf45-4b21-ad49-93cedff62a23 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:32.401881 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a6443e9d-cf45-4b21-ad49-93cedff62a23 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:32.402441 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a6443e9d-cf45-4b21-ad49-93cedff62a23 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:32.403216 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a6443e9d-cf45-4b21-ad49-93cedff62a23 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:32.403894 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a6443e9d-cf45-4b21-ad49-93cedff62a23 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:32.404319 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-a6443e9d-cf45-4b21-ad49-93cedff62a23 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:32.407699 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-d3c6556e-c5b1-4843-97fd-5b5e7b1a2fab req-f62e8fa0-37ad-4d69-80be-f2a3a7773e7c service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:32.408152 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-d3c6556e-c5b1-4843-97fd-5b5e7b1a2fab req-f62e8fa0-37ad-4d69-80be-f2a3a7773e7c service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:32.408578 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-d3c6556e-c5b1-4843-97fd-5b5e7b1a2fab req-f62e8fa0-37ad-4d69-80be-f2a3a7773e7c service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:32.421382 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-d3c6556e-c5b1-4843-97fd-5b5e7b1a2fab req-f62e8fa0-37ad-4d69-80be-f2a3a7773e7c service nova] Creating event network-changed:a45ce1ee-4208-4a19-9ed8-3145f8d6c124 for instance 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 on hv-cinder-85220 Aug 04 22:06:32.427458 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-d3c6556e-c5b1-4843-97fd-5b5e7b1a2fab req-f62e8fa0-37ad-4d69-80be-f2a3a7773e7c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038925 Aug 04 22:06:32.428415 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 659/1326] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 22:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:06:32.433068 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-a6443e9d-cf45-4b21-ad49-93cedff62a23 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Going to try to terminate instance {{(pid=136342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:06:32.786911 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-a6443e9d-cf45-4b21-ad49-93cedff62a23 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "DELETE /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 204 len: 0 microversion: 2.1 time: 0.400715 Aug 04 22:06:32.793381 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 668/1327] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 22:06:32 2022] DELETE /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:06:32.798842 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-75d474e6-51d2-4763-af5d-f3c5f7bb165c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:06:32.799857 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-75d474e6-51d2-4763-af5d-f3c5f7bb165c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:06:32.807304 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-75d474e6-51d2-4763-af5d-f3c5f7bb165c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:32.807795 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-75d474e6-51d2-4763-af5d-f3c5f7bb165c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:32.808228 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-75d474e6-51d2-4763-af5d-f3c5f7bb165c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:32.808935 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-75d474e6-51d2-4763-af5d-f3c5f7bb165c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:32.809390 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-75d474e6-51d2-4763-af5d-f3c5f7bb165c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:32.809811 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-75d474e6-51d2-4763-af5d-f3c5f7bb165c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:33.139788 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-75d474e6-51d2-4763-af5d-f3c5f7bb165c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:06:33.147622 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-75d474e6-51d2-4763-af5d-f3c5f7bb165c tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1578 microversion: 2.1 time: 0.353281 Aug 04 22:06:33.148187 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 660/1328] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:06:32 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1578 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:06:34.169962 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-438a4ca6-af00-46a6-8261-fd6ea51fca0b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:06:34.171291 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-438a4ca6-af00-46a6-8261-fd6ea51fca0b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:06:34.177808 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-438a4ca6-af00-46a6-8261-fd6ea51fca0b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:34.178252 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-438a4ca6-af00-46a6-8261-fd6ea51fca0b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:34.178684 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-438a4ca6-af00-46a6-8261-fd6ea51fca0b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:34.179376 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-438a4ca6-af00-46a6-8261-fd6ea51fca0b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:34.179822 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-438a4ca6-af00-46a6-8261-fd6ea51fca0b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:34.180241 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-438a4ca6-af00-46a6-8261-fd6ea51fca0b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:34.372157 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-438a4ca6-af00-46a6-8261-fd6ea51fca0b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:06:34.380047 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-438a4ca6-af00-46a6-8261-fd6ea51fca0b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1578 microversion: 2.1 time: 0.214707 Aug 04 22:06:34.380608 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 669/1329] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:06:34 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1578 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:06:35.418910 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-9b324eb3-eb35-431e-898d-881cbcad7df2 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:06:35.418910 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-9b324eb3-eb35-431e-898d-881cbcad7df2 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:06:35.418910 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9b324eb3-eb35-431e-898d-881cbcad7df2 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:35.418910 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9b324eb3-eb35-431e-898d-881cbcad7df2 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:35.420303 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9b324eb3-eb35-431e-898d-881cbcad7df2 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:35.420303 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9b324eb3-eb35-431e-898d-881cbcad7df2 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:35.420303 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9b324eb3-eb35-431e-898d-881cbcad7df2 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:35.420303 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-9b324eb3-eb35-431e-898d-881cbcad7df2 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:35.422024 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-4bcde850-81de-41dc-a536-c4d9a691d076 req-ef89198b-6254-4c37-834e-7edeeb300b63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b5d6ea-c4bc-44c8-a68d-9d19f09ab930", "name": "network-vif-deleted", "tag": "a45ce1ee-4208-4a19-9ed8-3145f8d6c124"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:06:35.432806 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-4bcde850-81de-41dc-a536-c4d9a691d076 req-ef89198b-6254-4c37-834e-7edeeb300b63 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:35.433347 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-4bcde850-81de-41dc-a536-c4d9a691d076 req-ef89198b-6254-4c37-834e-7edeeb300b63 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:35.433710 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-4bcde850-81de-41dc-a536-c4d9a691d076 req-ef89198b-6254-4c37-834e-7edeeb300b63 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:35.447021 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-4bcde850-81de-41dc-a536-c4d9a691d076 req-ef89198b-6254-4c37-834e-7edeeb300b63 service nova] Creating event network-vif-deleted:a45ce1ee-4208-4a19-9ed8-3145f8d6c124 for instance 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 on hv-cinder-85220 Aug 04 22:06:35.453119 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-4bcde850-81de-41dc-a536-c4d9a691d076 req-ef89198b-6254-4c37-834e-7edeeb300b63 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035818 Aug 04 22:06:35.453750 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 670/1330] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 22:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:06:35.486764 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-9b324eb3-eb35-431e-898d-881cbcad7df2 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:06:35.494563 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-9b324eb3-eb35-431e-898d-881cbcad7df2 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1393 microversion: 2.1 time: 0.096525 Aug 04 22:06:35.495119 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 661/1331] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:06:35 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1393 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:06:36.517983 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-60c1480e-cac0-4a2c-b34c-3ad739cb1dbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:06:36.518771 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-60c1480e-cac0-4a2c-b34c-3ad739cb1dbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:06:36.525800 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-60c1480e-cac0-4a2c-b34c-3ad739cb1dbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:36.526337 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-60c1480e-cac0-4a2c-b34c-3ad739cb1dbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:36.526829 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-60c1480e-cac0-4a2c-b34c-3ad739cb1dbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:36.527589 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-60c1480e-cac0-4a2c-b34c-3ad739cb1dbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:36.528039 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-60c1480e-cac0-4a2c-b34c-3ad739cb1dbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:36.528491 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-60c1480e-cac0-4a2c-b34c-3ad739cb1dbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:36.564638 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-60c1480e-cac0-4a2c-b34c-3ad739cb1dbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:36.565122 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-60c1480e-cac0-4a2c-b34c-3ad739cb1dbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:36.565552 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-60c1480e-cac0-4a2c-b34c-3ad739cb1dbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:36.565992 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.objects.instance [None req-60c1480e-cac0-4a2c-b34c-3ad739cb1dbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lazy-loading 'fault' on Instance uuid 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 {{(pid=136342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:06:36.608992 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-60c1480e-cac0-4a2c-b34c-3ad739cb1dbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:06:36.616732 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-60c1480e-cac0-4a2c-b34c-3ad739cb1dbf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 200 len: 1231 microversion: 2.1 time: 0.103850 Aug 04 22:06:36.617302 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 671/1332] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:06:36 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 1231 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:06:37.638709 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-5a877cba-d783-44f8-accb-fac79eb5cacf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:06:37.639445 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-5a877cba-d783-44f8-accb-fac79eb5cacf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:06:37.645780 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5a877cba-d783-44f8-accb-fac79eb5cacf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:37.646309 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5a877cba-d783-44f8-accb-fac79eb5cacf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:37.646743 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5a877cba-d783-44f8-accb-fac79eb5cacf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:37.647435 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5a877cba-d783-44f8-accb-fac79eb5cacf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:37.647883 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5a877cba-d783-44f8-accb-fac79eb5cacf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:37.648303 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-5a877cba-d783-44f8-accb-fac79eb5cacf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:37.661916 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-5a877cba-d783-44f8-accb-fac79eb5cacf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] HTTP exception thrown: Instance 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 could not be found. Aug 04 22:06:37.663507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-5a877cba-d783-44f8-accb-fac79eb5cacf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Request method failure captured: Aug 04 22:06:37.663507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 HTTP/1.1 Aug 04 22:06:37.663507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 22:06:37.663507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 22:06:37.663507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 22:06:37.663507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 22:06:37.663507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 22:06:37.663507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 22:06:37.663507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 22:06:37.663507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 22:06:37.663507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7EDqbTAyqTRIYjx4djC2yo4r6IBfu-T360DNuVrxA5OTXLwG7tTMU9F3lk0Pk3MnG61_Pgmt7lJovXdP5naAlCZlqHJbYAO_mR72tWMo-XSgOpimooySbpHezQEPFrvTbrLiwwuHFd1Mfmu9Vh2lZv3ew60c9v054QOROat-lGRGWsI Aug 04 22:06:37.663507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 22:06:37.663507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 22:06:37.663507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 22:06:37.663507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 22:06:37.663507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 22:06:37.663507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 22:06:37.663507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: ee8894a750724fb987a01514be0ab39b Aug 04 22:06:37.663507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-TestVolumeBootPattern-1050826126 Aug 04 22:06:37.663507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 22:06:37.663507 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 22:06:37.665374 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ee8894a750724fb987a01514be0ab39b", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ee8894a750724fb987a01514be0ab39b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee8894a750724fb987a01514be0ab39b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee8894a750724fb987a01514be0ab39b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 22:06:37.665374 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-TestVolumeBootPattern-1050826126 Aug 04 22:06:37.665374 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: ee8894a750724fb987a01514be0ab39b Aug 04 22:06:37.665374 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-TestVolumeBootPattern-1050826126 Aug 04 22:06:37.665374 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-TestVolumeBootPattern-1050826126-project Aug 04 22:06:37.665374 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 22:06:37.665374 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 22:06:37.665374 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: 292eee6c79214436962643db0a840708 Aug 04 22:06:37.665374 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-TestVolumeBootPattern-1050826126-project Aug 04 22:06:37.665374 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 22:06:37.665374 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Instance 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 could not be found. Aug 04 22:06:37.665374 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': '88b5d6ea-c4bc-44c8-a68d-9d19f09ab930'} Aug 04 22:06:37.666464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:06:37.666464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:06:37.666464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:06:37.666464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:06:37.666464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:06:37.666464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:06:37.666464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:06:37.666464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:06:37.666464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:06:37.666464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:06:37.666464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 could not be found. Aug 04 22:06:37.666464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 22:06:37.666464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:06:37.666464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 22:06:37.666464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:06:37.666464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:06:37.666464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:06:37.666464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:06:37.666464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:06:37.666464 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:06:37.668208 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:06:37.668208 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:06:37.668208 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:06:37.668208 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:06:37.668208 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:06:37.668208 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:06:37.668208 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:06:37.668208 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 could not be found. Aug 04 22:06:37.668208 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 22:06:37.668208 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:06:37.668208 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 22:06:37.668208 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:06:37.668208 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:06:37.668208 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:06:37.668208 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:06:37.668208 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:06:37.668208 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 could not be found. Aug 04 22:06:37.668208 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 22:06:37.670824 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-5a877cba-d783-44f8-accb-fac79eb5cacf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Returning 404 to user: Instance 88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:06:37.670824 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-5a877cba-d783-44f8-accb-fac79eb5cacf tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930" status: 404 len: 111 microversion: 2.1 time: 0.030150 Aug 04 22:06:37.670824 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 662/1333] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:06:37 2022] GET /compute/v2.1/servers/88b5d6ea-c4bc-44c8-a68d-9d19f09ab930 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:06:41.139875 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-7d6e2487-1e73-406d-a825-daf1a0a006cd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:06:41.140507 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7d6e2487-1e73-406d-a825-daf1a0a006cd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:06:41.144393 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [req-52f40cee-5d8a-414f-ac88-76ffd5ee978e req-712551df-f113-410a-8c7f-fbe6393f039a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3804577c-bf12-4560-a7a4-ec0e14e16550", "tag": "fbaef442-2379-4b0d-b9b9-098cd098cb5b"}]} {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:06:41.147609 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7d6e2487-1e73-406d-a825-daf1a0a006cd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:41.148097 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7d6e2487-1e73-406d-a825-daf1a0a006cd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:41.148738 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7d6e2487-1e73-406d-a825-daf1a0a006cd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:41.149451 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7d6e2487-1e73-406d-a825-daf1a0a006cd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:41.149901 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7d6e2487-1e73-406d-a825-daf1a0a006cd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:41.150611 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-7d6e2487-1e73-406d-a825-daf1a0a006cd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:41.156029 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-52f40cee-5d8a-414f-ac88-76ffd5ee978e req-712551df-f113-410a-8c7f-fbe6393f039a service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:41.158246 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-52f40cee-5d8a-414f-ac88-76ffd5ee978e req-712551df-f113-410a-8c7f-fbe6393f039a service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:41.158677 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [req-52f40cee-5d8a-414f-ac88-76ffd5ee978e req-712551df-f113-410a-8c7f-fbe6393f039a service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:41.173662 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.compute.server_external_events [req-52f40cee-5d8a-414f-ac88-76ffd5ee978e req-712551df-f113-410a-8c7f-fbe6393f039a service nova] Creating event network-changed:fbaef442-2379-4b0d-b9b9-098cd098cb5b for instance 3804577c-bf12-4560-a7a4-ec0e14e16550 on hv-cinder-85220 Aug 04 22:06:41.179153 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [req-52f40cee-5d8a-414f-ac88-76ffd5ee978e req-712551df-f113-410a-8c7f-fbe6393f039a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039690 Aug 04 22:06:41.180019 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 663/1334] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 22:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 22:06:41.183453 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-7d6e2487-1e73-406d-a825-daf1a0a006cd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Going to try to terminate instance {{(pid=136342) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 22:06:41.643524 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-7d6e2487-1e73-406d-a825-daf1a0a006cd tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 204 len: 0 microversion: 2.1 time: 0.509047 Aug 04 22:06:41.644110 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 672/1335] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 22:06:41 2022] DELETE /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 22:06:41.652943 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-b3dc7ea0-fe76-4383-855b-c6dc7c7e3d05 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:06:41.653929 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-b3dc7ea0-fe76-4383-855b-c6dc7c7e3d05 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:06:41.661326 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b3dc7ea0-fe76-4383-855b-c6dc7c7e3d05 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:41.661807 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b3dc7ea0-fe76-4383-855b-c6dc7c7e3d05 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:41.662269 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b3dc7ea0-fe76-4383-855b-c6dc7c7e3d05 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:41.662955 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b3dc7ea0-fe76-4383-855b-c6dc7c7e3d05 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:41.663509 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b3dc7ea0-fe76-4383-855b-c6dc7c7e3d05 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:41.663926 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-b3dc7ea0-fe76-4383-855b-c6dc7c7e3d05 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:41.878987 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-b3dc7ea0-fe76-4383-855b-c6dc7c7e3d05 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:06:41.887250 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-b3dc7ea0-fe76-4383-855b-c6dc7c7e3d05 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1577 microversion: 2.1 time: 0.238441 Aug 04 22:06:41.887840 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 664/1336] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:06:41 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1577 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:06:42.910596 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-1c0c0b00-af0d-4977-aa6b-13e4b3c0d9f0 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:06:42.911226 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-1c0c0b00-af0d-4977-aa6b-13e4b3c0d9f0 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:06:42.918055 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c0c0b00-af0d-4977-aa6b-13e4b3c0d9f0 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:42.918556 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c0c0b00-af0d-4977-aa6b-13e4b3c0d9f0 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:42.918990 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c0c0b00-af0d-4977-aa6b-13e4b3c0d9f0 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:42.920303 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c0c0b00-af0d-4977-aa6b-13e4b3c0d9f0 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:42.920825 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c0c0b00-af0d-4977-aa6b-13e4b3c0d9f0 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:42.921257 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-1c0c0b00-af0d-4977-aa6b-13e4b3c0d9f0 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:43.063451 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.policy [None req-1c0c0b00-af0d-4977-aa6b-13e4b3c0d9f0 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136342) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:06:43.071220 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-1c0c0b00-af0d-4977-aa6b-13e4b3c0d9f0 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1577 microversion: 2.1 time: 0.165086 Aug 04 22:06:43.071782 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 673/1337] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:06:42 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 22:06:44.098185 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-10b4f4e2-43a7-4952-8984-b1de5b983362 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:06:44.098185 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-10b4f4e2-43a7-4952-8984-b1de5b983362 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:06:44.103515 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-10b4f4e2-43a7-4952-8984-b1de5b983362 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:44.103998 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-10b4f4e2-43a7-4952-8984-b1de5b983362 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:44.104422 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-10b4f4e2-43a7-4952-8984-b1de5b983362 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:44.105115 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-10b4f4e2-43a7-4952-8984-b1de5b983362 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:44.105555 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-10b4f4e2-43a7-4952-8984-b1de5b983362 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:44.105968 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-10b4f4e2-43a7-4952-8984-b1de5b983362 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:44.208636 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-10b4f4e2-43a7-4952-8984-b1de5b983362 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:06:44.217137 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-10b4f4e2-43a7-4952-8984-b1de5b983362 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1391 microversion: 2.1 time: 0.127465 Aug 04 22:06:44.217506 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [req-75513841-479e-48d9-8504-91ca8091720c req-fba41070-8608-4e3a-bbbb-a9cc87203878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3804577c-bf12-4560-a7a4-ec0e14e16550", "name": "network-vif-deleted", "tag": "fbaef442-2379-4b0d-b9b9-098cd098cb5b"}]} {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 22:06:44.218184 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 665/1338] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:06:44 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1391 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:06:44.227773 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-75513841-479e-48d9-8504-91ca8091720c req-fba41070-8608-4e3a-bbbb-a9cc87203878 service nova] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:44.228250 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-75513841-479e-48d9-8504-91ca8091720c req-fba41070-8608-4e3a-bbbb-a9cc87203878 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:44.228706 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [req-75513841-479e-48d9-8504-91ca8091720c req-fba41070-8608-4e3a-bbbb-a9cc87203878 service nova] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:44.241230 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.compute.server_external_events [req-75513841-479e-48d9-8504-91ca8091720c req-fba41070-8608-4e3a-bbbb-a9cc87203878 service nova] Creating event network-vif-deleted:fbaef442-2379-4b0d-b9b9-098cd098cb5b for instance 3804577c-bf12-4560-a7a4-ec0e14e16550 on hv-cinder-85220 Aug 04 22:06:44.246669 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [req-75513841-479e-48d9-8504-91ca8091720c req-fba41070-8608-4e3a-bbbb-a9cc87203878 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033432 Aug 04 22:06:44.247260 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 674/1339] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 4 22:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 22:06:45.239924 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-d87fb2ff-cae7-49e8-b83d-d8f3256c094b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:06:45.240593 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-d87fb2ff-cae7-49e8-b83d-d8f3256c094b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:06:45.248225 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d87fb2ff-cae7-49e8-b83d-d8f3256c094b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:45.249978 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d87fb2ff-cae7-49e8-b83d-d8f3256c094b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:45.249978 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d87fb2ff-cae7-49e8-b83d-d8f3256c094b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:45.250454 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d87fb2ff-cae7-49e8-b83d-d8f3256c094b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:45.250918 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d87fb2ff-cae7-49e8-b83d-d8f3256c094b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:45.251346 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d87fb2ff-cae7-49e8-b83d-d8f3256c094b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:45.285228 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d87fb2ff-cae7-49e8-b83d-d8f3256c094b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:45.285712 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d87fb2ff-cae7-49e8-b83d-d8f3256c094b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:45.286172 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-d87fb2ff-cae7-49e8-b83d-d8f3256c094b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:45.286619 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.objects.instance [None req-d87fb2ff-cae7-49e8-b83d-d8f3256c094b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lazy-loading 'fault' on Instance uuid 3804577c-bf12-4560-a7a4-ec0e14e16550 {{(pid=136341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 22:06:45.329948 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.policy [None req-d87fb2ff-cae7-49e8-b83d-d8f3256c094b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '292eee6c79214436962643db0a840708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8894a750724fb987a01514be0ab39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136341) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 22:06:45.337412 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-d87fb2ff-cae7-49e8-b83d-d8f3256c094b tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 200 len: 1230 microversion: 2.1 time: 0.101659 Aug 04 22:06:45.338041 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 666/1340] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:06:45 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 22:06:46.360322 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f915d4ba-8013-42b5-9314-798e31225241 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:06:46.360935 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-f915d4ba-8013-42b5-9314-798e31225241 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 3804577c-bf12-4560-a7a4-ec0e14e16550] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:06:46.367104 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f915d4ba-8013-42b5-9314-798e31225241 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:46.367593 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f915d4ba-8013-42b5-9314-798e31225241 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:46.368026 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f915d4ba-8013-42b5-9314-798e31225241 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:46.368715 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f915d4ba-8013-42b5-9314-798e31225241 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:46.369167 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f915d4ba-8013-42b5-9314-798e31225241 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:46.369588 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-f915d4ba-8013-42b5-9314-798e31225241 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:46.383648 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-f915d4ba-8013-42b5-9314-798e31225241 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] HTTP exception thrown: Instance 3804577c-bf12-4560-a7a4-ec0e14e16550 could not be found. Aug 04 22:06:46.385262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f915d4ba-8013-42b5-9314-798e31225241 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Request method failure captured: Aug 04 22:06:46.385262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 HTTP/1.1 Aug 04 22:06:46.385262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 22:06:46.385262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 22:06:46.385262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 22:06:46.385262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 22:06:46.385262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 22:06:46.385262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 22:06:46.385262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 22:06:46.385262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 22:06:46.385262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7EDqbTAyqTRIYjx4djC2yo4r6IBfu-T360DNuVrxA5OTXLwG7tTMU9F3lk0Pk3MnG61_Pgmt7lJovXdP5naAlCZlqHJbYAO_mR72tWMo-XSgOpimooySbpHezQEPFrvTbrLiwwuHFd1Mfmu9Vh2lZv3ew60c9v054QOROat-lGRGWsI Aug 04 22:06:46.385262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 22:06:46.385262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 22:06:46.385262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 22:06:46.385262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 22:06:46.385262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 22:06:46.385262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 22:06:46.385262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: ee8894a750724fb987a01514be0ab39b Aug 04 22:06:46.385262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-TestVolumeBootPattern-1050826126 Aug 04 22:06:46.385262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 22:06:46.385262 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 22:06:46.387081 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ee8894a750724fb987a01514be0ab39b", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ee8894a750724fb987a01514be0ab39b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee8894a750724fb987a01514be0ab39b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee8894a750724fb987a01514be0ab39b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 22:06:46.387081 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-TestVolumeBootPattern-1050826126 Aug 04 22:06:46.387081 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: ee8894a750724fb987a01514be0ab39b Aug 04 22:06:46.387081 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-TestVolumeBootPattern-1050826126 Aug 04 22:06:46.387081 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-TestVolumeBootPattern-1050826126-project Aug 04 22:06:46.387081 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 22:06:46.387081 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 22:06:46.387081 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: 292eee6c79214436962643db0a840708 Aug 04 22:06:46.387081 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-TestVolumeBootPattern-1050826126-project Aug 04 22:06:46.387081 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 22:06:46.387081 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance 3804577c-bf12-4560-a7a4-ec0e14e16550 could not be found. Aug 04 22:06:46.387081 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': '3804577c-bf12-4560-a7a4-ec0e14e16550'} Aug 04 22:06:46.388066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:06:46.388066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:06:46.388066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:06:46.388066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:06:46.388066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:06:46.388066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:06:46.388066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:06:46.388066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:06:46.388066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:06:46.388066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:06:46.388066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3804577c-bf12-4560-a7a4-ec0e14e16550 could not be found. Aug 04 22:06:46.388066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 22:06:46.388066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:06:46.388066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 22:06:46.388066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:06:46.388066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:06:46.388066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:06:46.388066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:06:46.388066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:06:46.388066 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:06:46.389755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:06:46.389755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:06:46.389755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:06:46.389755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:06:46.389755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:06:46.389755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:06:46.389755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:06:46.389755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3804577c-bf12-4560-a7a4-ec0e14e16550 could not be found. Aug 04 22:06:46.389755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 22:06:46.389755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:06:46.389755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 22:06:46.389755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:06:46.389755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:06:46.389755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:06:46.389755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:06:46.389755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:06:46.389755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3804577c-bf12-4560-a7a4-ec0e14e16550 could not be found. Aug 04 22:06:46.389755 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 22:06:46.392810 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-f915d4ba-8013-42b5-9314-798e31225241 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Returning 404 to user: Instance 3804577c-bf12-4560-a7a4-ec0e14e16550 could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:06:46.392810 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-f915d4ba-8013-42b5-9314-798e31225241 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550" status: 404 len: 111 microversion: 2.1 time: 0.031228 Aug 04 22:06:46.392810 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 675/1341] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:06:46 2022] GET /compute/v2.1/servers/3804577c-bf12-4560-a7a4-ec0e14e16550 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:06:46.905799 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-51b811a0-6522-49d1-9b7e-eb0e0171c4c3 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:06:46.906367 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.compute.api [None req-51b811a0-6522-49d1-9b7e-eb0e0171c4c3 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136341) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:06:46.912790 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-51b811a0-6522-49d1-9b7e-eb0e0171c4c3 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:46.913283 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-51b811a0-6522-49d1-9b7e-eb0e0171c4c3 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:46.913715 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-51b811a0-6522-49d1-9b7e-eb0e0171c4c3 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:46.914449 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-51b811a0-6522-49d1-9b7e-eb0e0171c4c3 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:46.914902 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-51b811a0-6522-49d1-9b7e-eb0e0171c4c3 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:46.915324 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG oslo_concurrency.lockutils [None req-51b811a0-6522-49d1-9b7e-eb0e0171c4c3 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:46.928968 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.wsgi [None req-51b811a0-6522-49d1-9b7e-eb0e0171c4c3 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] HTTP exception thrown: Instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 could not be found. Aug 04 22:06:46.930741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-51b811a0-6522-49d1-9b7e-eb0e0171c4c3 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Request method failure captured: Aug 04 22:06:46.930741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: request: DELETE /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 HTTP/1.1 Aug 04 22:06:46.930741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept: application/json Aug 04 22:06:46.930741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Accept-Encoding: identity Aug 04 22:06:46.930741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Connection: close Aug 04 22:06:46.930741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Length: 0 Aug 04 22:06:46.930741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Content-Type: application/json Aug 04 22:06:46.930741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Host: 10.222.0.73 Aug 04 22:06:46.930741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Openstack-System-Scope: None Aug 04 22:06:46.930741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: User-Agent: python-urllib3/1.26.11 Aug 04 22:06:46.930741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Auth-Token: gAAAAABi7EDqbTAyqTRIYjx4djC2yo4r6IBfu-T360DNuVrxA5OTXLwG7tTMU9F3lk0Pk3MnG61_Pgmt7lJovXdP5naAlCZlqHJbYAO_mR72tWMo-XSgOpimooySbpHezQEPFrvTbrLiwwuHFd1Mfmu9Vh2lZv3ew60c9v054QOROat-lGRGWsI Aug 04 22:06:46.930741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Id: None Aug 04 22:06:46.930741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Domain-Name: None Aug 04 22:06:46.930741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Identity-Status: Confirmed Aug 04 22:06:46.930741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Is-Admin-Project: True Aug 04 22:06:46.930741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Id: default Aug 04 22:06:46.930741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Domain-Name: Default Aug 04 22:06:46.930741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Id: ee8894a750724fb987a01514be0ab39b Aug 04 22:06:46.930741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Project-Name: tempest-TestVolumeBootPattern-1050826126 Aug 04 22:06:46.930741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Role: reader,member Aug 04 22:06:46.930741 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Roles: reader,member Aug 04 22:06:46.933344 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ee8894a750724fb987a01514be0ab39b", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ee8894a750724fb987a01514be0ab39b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee8894a750724fb987a01514be0ab39b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee8894a750724fb987a01514be0ab39b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 22:06:46.933344 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant: tempest-TestVolumeBootPattern-1050826126 Aug 04 22:06:46.933344 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Id: ee8894a750724fb987a01514be0ab39b Aug 04 22:06:46.933344 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-Tenant-Name: tempest-TestVolumeBootPattern-1050826126 Aug 04 22:06:46.933344 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User: tempest-TestVolumeBootPattern-1050826126-project Aug 04 22:06:46.933344 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Id: default Aug 04 22:06:46.933344 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Domain-Name: Default Aug 04 22:06:46.933344 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Id: 292eee6c79214436962643db0a840708 Aug 04 22:06:46.933344 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: X-User-Name: tempest-TestVolumeBootPattern-1050826126-project Aug 04 22:06:46.933344 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: method: > Aug 04 22:06:46.933344 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: exception: Instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 could not be found. Aug 04 22:06:46.933344 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: action_args: {'id': '1de7b9b7-4e16-410d-aca1-86903eb1f8b6'} Aug 04 22:06:46.934791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:06:46.934791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:06:46.934791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:06:46.934791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:06:46.934791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:06:46.934791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:06:46.934791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:06:46.934791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:06:46.934791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:06:46.934791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:06:46.934791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 could not be found. Aug 04 22:06:46.934791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 22:06:46.934791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:06:46.934791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 22:06:46.934791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:06:46.934791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:06:46.934791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:06:46.934791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:06:46.934791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:06:46.934791 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:06:46.937470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:06:46.937470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 22:06:46.937470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 22:06:46.937470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 22:06:46.937470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 22:06:46.937470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:06:46.937470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:06:46.937470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:06:46.937470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:06:46.937470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 could not be found. Aug 04 22:06:46.937470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 22:06:46.937470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:06:46.937470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 22:06:46.937470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:06:46.937470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:06:46.937470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:06:46.937470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:06:46.937470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:06:46.937470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 could not be found. Aug 04 22:06:46.937470 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: ERROR nova.api.openstack.wsgi Aug 04 22:06:46.940071 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-51b811a0-6522-49d1-9b7e-eb0e0171c4c3 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Returning 404 to user: Instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 could not be found. {{(pid=136341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:06:46.940071 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-51b811a0-6522-49d1-9b7e-eb0e0171c4c3 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 404 len: 111 microversion: 2.1 time: 0.031022 Aug 04 22:06:46.940071 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 667/1342] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 4 22:06:46 2022] DELETE /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 22:06:46.941074 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8fa98111-811f-4b51-9dc2-474a430e6fad tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '>' {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:06:46.941690 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.compute.api [None req-8fa98111-811f-4b51-9dc2-474a430e6fad tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] [instance: 1de7b9b7-4e16-410d-aca1-86903eb1f8b6] Fetching instance by UUID {{(pid=136342) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 22:06:46.947844 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8fa98111-811f-4b51-9dc2-474a430e6fad tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:46.948330 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8fa98111-811f-4b51-9dc2-474a430e6fad tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:46.948768 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8fa98111-811f-4b51-9dc2-474a430e6fad tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:46.949460 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8fa98111-811f-4b51-9dc2-474a430e6fad tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Acquiring lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 22:06:46.949916 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8fa98111-811f-4b51-9dc2-474a430e6fad tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 22:06:46.950396 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG oslo_concurrency.lockutils [None req-8fa98111-811f-4b51-9dc2-474a430e6fad tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Lock "4dbdb380-f63b-47cb-aa2b-0e711dd9c947" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 22:06:46.965132 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.wsgi [None req-8fa98111-811f-4b51-9dc2-474a430e6fad tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] HTTP exception thrown: Instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 could not be found. Aug 04 22:06:46.967762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8fa98111-811f-4b51-9dc2-474a430e6fad tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Request method failure captured: Aug 04 22:06:46.967762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: request: GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 HTTP/1.1 Aug 04 22:06:46.967762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept: application/json Aug 04 22:06:46.967762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Accept-Encoding: identity Aug 04 22:06:46.967762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Connection: close Aug 04 22:06:46.967762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Length: 0 Aug 04 22:06:46.967762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Content-Type: application/json Aug 04 22:06:46.967762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Host: 10.222.0.73 Aug 04 22:06:46.967762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Openstack-System-Scope: None Aug 04 22:06:46.967762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: User-Agent: python-urllib3/1.26.11 Aug 04 22:06:46.967762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Auth-Token: gAAAAABi7EDqbTAyqTRIYjx4djC2yo4r6IBfu-T360DNuVrxA5OTXLwG7tTMU9F3lk0Pk3MnG61_Pgmt7lJovXdP5naAlCZlqHJbYAO_mR72tWMo-XSgOpimooySbpHezQEPFrvTbrLiwwuHFd1Mfmu9Vh2lZv3ew60c9v054QOROat-lGRGWsI Aug 04 22:06:46.967762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Id: None Aug 04 22:06:46.967762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Domain-Name: None Aug 04 22:06:46.967762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Identity-Status: Confirmed Aug 04 22:06:46.967762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Is-Admin-Project: True Aug 04 22:06:46.967762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Id: default Aug 04 22:06:46.967762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Domain-Name: Default Aug 04 22:06:46.967762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Id: ee8894a750724fb987a01514be0ab39b Aug 04 22:06:46.967762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Project-Name: tempest-TestVolumeBootPattern-1050826126 Aug 04 22:06:46.967762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Role: reader,member Aug 04 22:06:46.967762 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Roles: reader,member Aug 04 22:06:46.969497 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ee8894a750724fb987a01514be0ab39b", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ee8894a750724fb987a01514be0ab39b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee8894a750724fb987a01514be0ab39b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee8894a750724fb987a01514be0ab39b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 04 22:06:46.969497 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant: tempest-TestVolumeBootPattern-1050826126 Aug 04 22:06:46.969497 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Id: ee8894a750724fb987a01514be0ab39b Aug 04 22:06:46.969497 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-Tenant-Name: tempest-TestVolumeBootPattern-1050826126 Aug 04 22:06:46.969497 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User: tempest-TestVolumeBootPattern-1050826126-project Aug 04 22:06:46.969497 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Id: default Aug 04 22:06:46.969497 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Domain-Name: Default Aug 04 22:06:46.969497 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Id: 292eee6c79214436962643db0a840708 Aug 04 22:06:46.969497 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: X-User-Name: tempest-TestVolumeBootPattern-1050826126-project Aug 04 22:06:46.969497 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: method: > Aug 04 22:06:46.969497 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: exception: Instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 could not be found. Aug 04 22:06:46.969497 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: action_args: {'id': '1de7b9b7-4e16-410d-aca1-86903eb1f8b6'} Aug 04 22:06:46.970408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: {{(pid=136342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 22:06:46.970408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:06:46.970408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 22:06:46.970408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 22:06:46.970408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 22:06:46.970408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 22:06:46.970408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 22:06:46.970408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 22:06:46.970408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 22:06:46.970408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 22:06:46.970408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 could not be found. Aug 04 22:06:46.970408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 22:06:46.970408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:06:46.970408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 22:06:46.970408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:06:46.970408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:06:46.970408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:06:46.970408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 22:06:46.970408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 22:06:46.970408 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 22:06:46.971763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 22:06:46.971763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 22:06:46.971763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 22:06:46.971763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 22:06:46.971763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 22:06:46.971763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 22:06:46.971763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 22:06:46.971763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 could not be found. Aug 04 22:06:46.971763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 22:06:46.971763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 22:06:46.971763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 22:06:46.971763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 22:06:46.971763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 22:06:46.971763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 22:06:46.971763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 22:06:46.971763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 22:06:46.971763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 could not be found. Aug 04 22:06:46.971763 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: ERROR nova.api.openstack.wsgi Aug 04 22:06:46.973068 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: DEBUG nova.api.openstack.wsgi [None req-8fa98111-811f-4b51-9dc2-474a430e6fad tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Returning 404 to user: Instance 1de7b9b7-4e16-410d-aca1-86903eb1f8b6 could not be found. {{(pid=136342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 22:06:46.973068 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO nova.api.openstack.requestlog [None req-8fa98111-811f-4b51-9dc2-474a430e6fad tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6" status: 404 len: 111 microversion: 2.1 time: 0.032104 Aug 04 22:06:46.973068 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: [pid: 136342|app: 0|req: 676/1343] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 4 22:06:46 2022] GET /compute/v2.1/servers/1de7b9b7-4e16-410d-aca1-86903eb1f8b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 22:06:48.515920 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: DEBUG nova.api.openstack.wsgi [None req-ac0a1a91-766d-4195-8487-d3f12bc9bbd3 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] Calling method '.version_select at 0x7f3c108104c0>' {{(pid=136341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 22:06:48.597990 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO nova.api.openstack.requestlog [None req-ac0a1a91-766d-4195-8487-d3f12bc9bbd3 tempest-TestVolumeBootPattern-1050826126 tempest-TestVolumeBootPattern-1050826126-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1795731597" status: 202 len: 0 microversion: 2.1 time: 0.086069 Aug 04 22:06:48.598739 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: [pid: 136341|app: 0|req: 668/1344] 10.222.0.73 () {58 vars in 1263 bytes} [Thu Aug 4 22:06:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1795731597 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 22:07:03.358245 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:07:03.358891 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Thu Aug 4 22:07:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:07:15.198359 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:07:15.199190 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Thu Aug 4 22:07:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:08:55.275843 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:08:55.276583 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Thu Aug 4 22:08:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:09:08.115626 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:09:08.116422 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Thu Aug 4 22:09:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:09:08.647695 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:09:08.648397 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Thu Aug 4 22:09:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:10:23.366788 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:10:23.367479 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Thu Aug 4 22:10:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:10:35.207851 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:10:35.208540 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Thu Aug 4 22:10:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:12:07.556425 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:12:07.557291 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Thu Aug 4 22:12:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:12:15.285892 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:12:15.286744 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Thu Aug 4 22:12:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:12:28.127034 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:12:28.127623 dv-cinder-852209-1-iscsi devstack@n-api.service[136342]: Thu Aug 4 22:12:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 22:12:28.658548 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 22:12:28.659133 dv-cinder-852209-1-iscsi devstack@n-api.service[136341]: Thu Aug 4 22:12:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!